[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:49:34 dist-test-slave-92m1 krb5kdc[24088](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:49:34 dist-test-slave-92m1 krb5kdc[24088](info): set up 2 sockets
Aug 09 22:49:34 dist-test-slave-92m1 krb5kdc[24088](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 22:49:36.058115 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:49:36 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:49:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:49:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:49:36.288182 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:43503
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:43503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:36.667747 24105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:36.668159 24105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:36.668355 24105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:36.676234 24105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:49:36.676358 24105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:36.676447 24105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:36.676563 24105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:49:36.676646 24105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:49:36.687280 24105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:43503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:43503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:36.688763 24105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:36.690228 24105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:36.703781 24111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:36.703742 24116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:36.703804 24113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:36.704784 24105 server_base.cc:1034] running on GCE node
I20260809 22:49:36.705708 24105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:36.707269 24105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:36.708510 24105 hybrid_clock.cc:648] HybridClock initialized: now 1786315776708436 us; error 59 us; skew 500 ppm
I20260809 22:49:36.708904 24105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:36 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315776, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:36.712626 24105 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:49:36.714267 24105 webserver.cc:460] Webserver started at http://127.23.131.126:35845/ using document root <none> and password file <none>
I20260809 22:49:36.715032 24105 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:36.715147 24105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:36.715508 24105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:36.719009 24105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "b5d72a443d084fcfb357fc1d4e9c65f0"
format_stamp: "Formatted at 2026-08-09 22:49:36 on dist-test-slave-92m1"
server_key: "95c616888689ff72d64dfc717220cc62"
server_key_iv: "4f35ad7ffeb12837150c38f32ccbd7d5"
server_key_version: "encryptionkey@0"
I20260809 22:49:36.719908 24105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "b5d72a443d084fcfb357fc1d4e9c65f0"
format_stamp: "Formatted at 2026-08-09 22:49:36 on dist-test-slave-92m1"
server_key: "95c616888689ff72d64dfc717220cc62"
server_key_iv: "4f35ad7ffeb12837150c38f32ccbd7d5"
server_key_version: "encryptionkey@0"
I20260809 22:49:36.725930 24105 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 22:49:36.729873 24126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:36.731421 24105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:49:36.731616 24105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "b5d72a443d084fcfb357fc1d4e9c65f0"
format_stamp: "Formatted at 2026-08-09 22:49:36 on dist-test-slave-92m1"
server_key: "95c616888689ff72d64dfc717220cc62"
server_key_iv: "4f35ad7ffeb12837150c38f32ccbd7d5"
server_key_version: "encryptionkey@0"
I20260809 22:49:36.731905 24105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:36.757934 24105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:36.763332 24105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:36.763682 24105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:36.787148 24105 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:43503
I20260809 22:49:36.787156 24206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:43503 every 8 connection(s)
I20260809 22:49:36.788806 24105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:49:36.793321 24208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:36.793345 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24105
I20260809 22:49:36.793682 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:49:36.796496 24077 external_mini_cluster.cc:1428] Setting key bfec3ca2aca3d558fc67d65b580ae648
I20260809 22:49:36.807005 24208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0: Bootstrap starting.
I20260809 22:49:36.810463 24208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:36.811846 24208 log.cc:824] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:36.816059 24208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0: No bootstrap required, opened a new log
I20260809 22:49:36.826107 24208 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43503 } }
I20260809 22:49:36.826543 24208 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:36.826684 24208 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d72a443d084fcfb357fc1d4e9c65f0, State: Initialized, Role: FOLLOWER
I20260809 22:49:36.827488 24208 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43503 } }
I20260809 22:49:36.827752 24208 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:49:36.827896 24208 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:49:36.828074 24208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 22:49:36 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:36.830978 24208 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43503 } }
I20260809 22:49:36.831743 24208 leader_election.cc:302] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5d72a443d084fcfb357fc1d4e9c65f0; no voters:
I20260809 22:49:36.832655 24208 leader_election.cc:288] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:49:36.832794 24216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:36.833877 24216 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [term 1 LEADER]: Becoming Leader. State: Replica: b5d72a443d084fcfb357fc1d4e9c65f0, State: Running, Role: LEADER
I20260809 22:49:36.834558 24216 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43503 } }
I20260809 22:49:36.836205 24208 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:49:36.838479 24219 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5d72a443d084fcfb357fc1d4e9c65f0. Latest consensus state: current_term: 1 leader_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43503 } } }
I20260809 22:49:36.838462 24220 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5d72a443d084fcfb357fc1d4e9c65f0" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43503 } } }
I20260809 22:49:36.838955 24219 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:36.838958 24220 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0 [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:36.846496 24211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:36.801442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36352 (local address 127.23.131.126:43503)
0809 22:49:36.802463 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:36.802480 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:36.803966 (+ 1486us) server_negotiation.cc:407] Connection header received
0809 22:49:36.814330 (+ 10364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:36.814363 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:36.814955 (+ 592us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:36.815499 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:36.818690 (+ 3191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:36.820876 (+ 2186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:36.822655 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:36.823886 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:36.824160 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:36.830883 (+ 6723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:36.830897 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:36.830918 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:36.830995 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:36.836294 (+ 5299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:36.837939 (+ 1645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:36.837947 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:36.837954 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:36.838230 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:36.838914 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:36.838923 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:36.838926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:36.839807 (+ 881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:36.843662 (+ 3855us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:36.844034 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 22:49:36.844650 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":457,"threads_started":1}
I20260809 22:49:36.850385 24224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:49:36.857282 24224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:49:36.868214 24224 catalog_manager.cc:1347] Generated new cluster ID: df0956e2e22e4bef9f20df734a9edf0b
I20260809 22:49:36.868356 24224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:49:36.882923 24224 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:49:36.884560 24224 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:49:36.897431 24224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5d72a443d084fcfb357fc1d4e9c65f0: Generated new TSK 0
I20260809 22:49:36.898456 24224 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:49:36.959597 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43503
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:37.327869 24254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:37.328184 24254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:37.328289 24254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:37.336037 24254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:37.336156 24254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:37.336287 24254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:49:37.347468 24254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43503
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:37.348791 24254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:37.350353 24254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:37.364380 24263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:37.364385 24269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:37.364712 24265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:37.365796 24254 server_base.cc:1034] running on GCE node
I20260809 22:49:37.366530 24254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:37.367697 24254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:37.368943 24254 hybrid_clock.cc:648] HybridClock initialized: now 1786315777368868 us; error 69 us; skew 500 ppm
I20260809 22:49:37.369311 24254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:37 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315777, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:37.372902 24254 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:49:37.374621 24254 webserver.cc:460] Webserver started at http://127.23.131.65:44653/ using document root <none> and password file <none>
I20260809 22:49:37.375468 24254 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:37.375626 24254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:37.375972 24254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:37.379034 24254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "5f2cdfd2abd34c8e88e15a781f67cbf5"
format_stamp: "Formatted at 2026-08-09 22:49:37 on dist-test-slave-92m1"
server_key: "f67e481f115cf59d8d0839864a98c8c3"
server_key_iv: "469460c45ce91aa5bdb0095f2cceba43"
server_key_version: "encryptionkey@0"
I20260809 22:49:37.379910 24254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "5f2cdfd2abd34c8e88e15a781f67cbf5"
format_stamp: "Formatted at 2026-08-09 22:49:37 on dist-test-slave-92m1"
server_key: "f67e481f115cf59d8d0839864a98c8c3"
server_key_iv: "469460c45ce91aa5bdb0095f2cceba43"
server_key_version: "encryptionkey@0"
I20260809 22:49:37.385255 24254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:49:37.388989 24278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:37.390413 24254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:49:37.390620 24254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "5f2cdfd2abd34c8e88e15a781f67cbf5"
format_stamp: "Formatted at 2026-08-09 22:49:37 on dist-test-slave-92m1"
server_key: "f67e481f115cf59d8d0839864a98c8c3"
server_key_iv: "469460c45ce91aa5bdb0095f2cceba43"
server_key_version: "encryptionkey@0"
I20260809 22:49:37.390843 24254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:37.425531 24254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:37.430402 24254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:37.430742 24254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:37.432026 24254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:49:37.433800 24254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:37.433912 24254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:37.434080 24254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:37.434175 24254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:37.473394 24254 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:40897
I20260809 22:49:37.473433 24450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:40897 every 8 connection(s)
I20260809 22:49:37.474942 24254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:49:37.484797 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24254
I20260809 22:49:37.485066 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:49:37.485734 24077 external_mini_cluster.cc:1428] Setting key dc5462353b76dfb7a72213ac60b2e2e9
Aug 09 22:49:37 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315777, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:37.496554 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:37.477840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:49221 (local address 127.23.131.126:43503)
0809 22:49:37.478417 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:37.478422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:37.479175 (+ 753us) server_negotiation.cc:407] Connection header received
0809 22:49:37.481230 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:37.481235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:37.481335 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:37.481471 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:37.483179 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:37.483993 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:37.485723 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:37.486225 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:37.486372 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:37.490202 (+ 3830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:37.490207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:37.490211 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:37.490243 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:37.493080 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:37.493871 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:37.493877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:37.493883 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:37.494010 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:37.494523 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:37.494531 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:37.494535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:37.494827 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:37.495008 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:37.495910 (+ 902us) server_negotiation.cc:299] Negotiation successful
0809 22:49:37.496164 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":352,"threads_started":1}
I20260809 22:49:37.497632 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:37.478258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:43503 (local address 127.23.131.65:49221)
0809 22:49:37.478997 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:37.479047 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:37.480919 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:37.481724 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:37.481733 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:37.482318 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:37.482986 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:37.483004 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:37.484169 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:37.484174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:37.485573 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:37.485586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:37.486487 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:37.486496 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:37.486752 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:37.487563 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:37.487603 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:37.489952 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:37.493246 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:37.493256 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:37.493274 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:37.493735 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:37.494127 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:37.494133 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:37.494137 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:37.494398 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:37.494976 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:37.494985 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:37.495438 (+ 453us) client_negotiation.cc:769] Sending connection context
0809 22:49:37.495807 (+ 369us) client_negotiation.cc:240] Negotiation successful
0809 22:49:37.496396 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":289,"threads_started":1}
I20260809 22:49:37.499459 24451 heartbeater.cc:347] Connected to a master server at 127.23.131.126:43503
I20260809 22:49:37.499784 24451 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:37.500541 24451 heartbeater.cc:511] Master 127.23.131.126:43503 requested a full tablet report, sending...
I20260809 22:49:37.503087 24156 ts_manager.cc:194] Registered new tserver with Master: 5f2cdfd2abd34c8e88e15a781f67cbf5 (127.23.131.65:40897)
I20260809 22:49:37.505535 24156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:49221
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:49:37.538822 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43503
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:37.900367 24459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:37.900671 24459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:37.900854 24459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:37.908792 24459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:37.908957 24459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:37.909160 24459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:49:37.919816 24459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43503
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:37.921283 24459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:37.922789 24459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:37.937134 24466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:37.937192 24469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:37.937237 24465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:37.938091 24459 server_base.cc:1034] running on GCE node
I20260809 22:49:37.938815 24459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:37.939901 24459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:37.941147 24459 hybrid_clock.cc:648] HybridClock initialized: now 1786315777941094 us; error 49 us; skew 500 ppm
I20260809 22:49:37.941489 24459 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:37 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315777, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:37.944936 24459 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:49:37.946517 24459 webserver.cc:460] Webserver started at http://127.23.131.66:34489/ using document root <none> and password file <none>
I20260809 22:49:37.947326 24459 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:37.947497 24459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:37.947829 24459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:37.950995 24459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "8cf0159a2cbe4450af2ce73fc3b4fb88"
format_stamp: "Formatted at 2026-08-09 22:49:37 on dist-test-slave-92m1"
server_key: "76b5ca905379237d11970e3c9f2b6e18"
server_key_iv: "257b70eac988fe217371f0bb93ad99be"
server_key_version: "encryptionkey@0"
I20260809 22:49:37.951892 24459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "8cf0159a2cbe4450af2ce73fc3b4fb88"
format_stamp: "Formatted at 2026-08-09 22:49:37 on dist-test-slave-92m1"
server_key: "76b5ca905379237d11970e3c9f2b6e18"
server_key_iv: "257b70eac988fe217371f0bb93ad99be"
server_key_version: "encryptionkey@0"
I20260809 22:49:37.957497 24459 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:49:37.961376 24483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:37.963690 24459 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 22:49:37.963891 24459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "8cf0159a2cbe4450af2ce73fc3b4fb88"
format_stamp: "Formatted at 2026-08-09 22:49:37 on dist-test-slave-92m1"
server_key: "76b5ca905379237d11970e3c9f2b6e18"
server_key_iv: "257b70eac988fe217371f0bb93ad99be"
server_key_version: "encryptionkey@0"
I20260809 22:49:37.964214 24459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:37.983593 24459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:37.987919 24459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:37.988190 24459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:37.989185 24459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:49:37.990659 24459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:37.990736 24459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:37.990823 24459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:37.990883 24459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:38.027854 24459 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46769
I20260809 22:49:38.027911 24650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46769 every 8 connection(s)
I20260809 22:49:38.029296 24459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:49:38.035050 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24459
I20260809 22:49:38.035275 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:49:38.036017 24077 external_mini_cluster.cc:1428] Setting key 5c9fe0ba795309573bbd2416b5014432
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315777, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:38.052887 24656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.031966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:43193 (local address 127.23.131.126:43503)
0809 22:49:38.032462 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.032468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.033590 (+ 1122us) server_negotiation.cc:407] Connection header received
0809 22:49:38.035817 (+ 2227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.035823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.035926 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.036060 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.038274 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.039361 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.040960 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.041746 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.041954 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.045845 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:38.045854 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:38.045861 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:38.045907 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:38.049141 (+ 3234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.050139 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.050143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.050145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.050275 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.050818 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.050821 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.050823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.051169 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:38.051356 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:38.052428 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0809 22:49:38.052607 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":225,"threads_started":1}
I20260809 22:49:38.054499 24661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.032647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:43503 (local address 127.23.131.66:43193)
0809 22:49:38.033410 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:38.033456 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:38.035197 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:38.036361 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:38.036377 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:38.037232 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:38.038068 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:38.038100 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.039525 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.039529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:38.040801 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:38.040815 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.042015 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.042020 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:38.042242 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.042987 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:38.043012 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:38.045609 (+ 2597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:38.049293 (+ 3684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:38.049305 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:38.049327 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:38.050019 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:38.050390 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:38.050397 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:38.050404 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:38.050668 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:38.051347 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:38.051358 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:38.051940 (+ 582us) client_negotiation.cc:769] Sending connection context
0809 22:49:38.052302 (+ 362us) client_negotiation.cc:240] Negotiation successful
0809 22:49:38.052934 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":289,"threads_started":1}
I20260809 22:49:38.056145 24651 heartbeater.cc:347] Connected to a master server at 127.23.131.126:43503
I20260809 22:49:38.056495 24651 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:38.057282 24651 heartbeater.cc:511] Master 127.23.131.126:43503 requested a full tablet report, sending...
I20260809 22:49:38.058845 24156 ts_manager.cc:194] Registered new tserver with Master: 8cf0159a2cbe4450af2ce73fc3b4fb88 (127.23.131.66:46769)
I20260809 22:49:38.059860 24156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:43193
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:49:38.089814 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43503
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:38.451146 24667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:38.451538 24667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:38.451725 24667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:38.459350 24667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:38.459479 24667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:38.459682 24667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:49:38.470355 24667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43503
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:38.471953 24667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:38.473534 24667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:38.487659 24675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:38.487797 24676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:38.487808 24681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:38.488876 24667 server_base.cc:1034] running on GCE node
I20260809 22:49:38.489552 24667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:38.490579 24667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:38.491837 24667 hybrid_clock.cc:648] HybridClock initialized: now 1786315778491787 us; error 58 us; skew 500 ppm
I20260809 22:49:38.492183 24667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:38.495569 24667 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:49:38.497210 24667 webserver.cc:460] Webserver started at http://127.23.131.67:33603/ using document root <none> and password file <none>
I20260809 22:49:38.497898 24667 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:38.498008 24667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:38.498291 24667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:38.501324 24667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "47c318b644c444d7ba57976917f6beb1"
format_stamp: "Formatted at 2026-08-09 22:49:38 on dist-test-slave-92m1"
server_key: "59470cbb318fa341013166f1f909874a"
server_key_iv: "dbd4cda747b484b383232105925f1bf3"
server_key_version: "encryptionkey@0"
I20260809 22:49:38.502065 24667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "47c318b644c444d7ba57976917f6beb1"
format_stamp: "Formatted at 2026-08-09 22:49:38 on dist-test-slave-92m1"
server_key: "59470cbb318fa341013166f1f909874a"
server_key_iv: "dbd4cda747b484b383232105925f1bf3"
server_key_version: "encryptionkey@0"
I20260809 22:49:38.507735 24667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:49:38.508946 24451 heartbeater.cc:503] Master 127.23.131.126:43503 was elected leader, sending a full tablet report...
I20260809 22:49:38.511826 24695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:38.513252 24667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:49:38.513453 24667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "47c318b644c444d7ba57976917f6beb1"
format_stamp: "Formatted at 2026-08-09 22:49:38 on dist-test-slave-92m1"
server_key: "59470cbb318fa341013166f1f909874a"
server_key_iv: "dbd4cda747b484b383232105925f1bf3"
server_key_version: "encryptionkey@0"
I20260809 22:49:38.513676 24667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:38.535835 24667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:38.541011 24667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:38.541343 24667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:38.542389 24667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:49:38.543830 24667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:38.543946 24667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:38.544104 24667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:38.544181 24667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:38.581004 24667 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:41921
I20260809 22:49:38.581049 24876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:41921 every 8 connection(s)
I20260809 22:49:38.582427 24667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:49:38.583696 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24667
I20260809 22:49:38.583913 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:49:38.584477 24077 external_mini_cluster.cc:1428] Setting key 736d26911ba5896b2b1b4cdbd323ad60
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:38.604856 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.585354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:49903 (local address 127.23.131.126:43503)
0809 22:49:38.585901 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.585906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.587197 (+ 1291us) server_negotiation.cc:407] Connection header received
0809 22:49:38.589618 (+ 2421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.589623 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.589725 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.589844 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.591417 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.592235 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.593899 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.594291 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.594431 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.598228 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:38.598234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:38.598237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:38.598271 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:38.601587 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.602345 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.602350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.602354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.602507 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.602961 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.602966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.602969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.603330 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:38.603494 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:38.604224 (+ 730us) server_negotiation.cc:299] Negotiation successful
0809 22:49:38.604450 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":236,"threads_started":1}
I20260809 22:49:38.605839 24880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.585914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:43503 (local address 127.23.131.67:49903)
0809 22:49:38.587035 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:38.587094 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:38.589344 (+ 2250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:38.590089 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:38.590097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:38.590640 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:38.591195 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:38.591272 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.592387 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.592408 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:38.593727 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:38.593740 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.594539 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.594546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:38.594781 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.595540 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:38.595570 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:38.597987 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:38.601724 (+ 3737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:38.601734 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:38.601750 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:38.602216 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:38.602624 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:38.602634 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:38.602638 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:38.602835 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:38.603460 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:38.603469 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:38.603844 (+ 375us) client_negotiation.cc:769] Sending connection context
0809 22:49:38.604119 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 22:49:38.604686 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":527,"threads_started":1}
I20260809 22:49:38.607229 24877 heartbeater.cc:347] Connected to a master server at 127.23.131.126:43503
I20260809 22:49:38.607499 24877 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:38.608183 24877 heartbeater.cc:511] Master 127.23.131.126:43503 requested a full tablet report, sending...
I20260809 22:49:38.609576 24156 ts_manager.cc:194] Registered new tserver with Master: 47c318b644c444d7ba57976917f6beb1 (127.23.131.67:41921)
I20260809 22:49:38.610410 24156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:49903
I20260809 22:49:38.613831 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:38.671378 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.655642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.23.131.65:40897)
0809 22:49:38.656491 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.656498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.656549 (+ 51us) server_negotiation.cc:407] Connection header received
0809 22:49:38.656627 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.656633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.656864 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.656992 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.658425 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.659525 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.660742 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.661300 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.661400 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.665475 (+ 4075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:38.665487 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:38.665502 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:38.665539 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:38.668700 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.669308 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.669315 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.669317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.669448 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.669810 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.669813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.669815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.670225 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:38.670465 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:38.670800 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 22:49:38.671001 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":542,"threads_started":1}
W20260809 22:49:38.672809 24321 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59114
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:38.728138 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.713398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59120 (local address 127.23.131.65:40897)
0809 22:49:38.713660 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.713667 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.713848 (+ 181us) server_negotiation.cc:407] Connection header received
0809 22:49:38.714094 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.714100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.714166 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.714279 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.715780 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.716483 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.717864 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.718402 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.718616 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.722706 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:38.722711 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:38.722714 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:38.722751 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:38.725355 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.726007 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.726011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.726013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.726144 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.726547 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.726550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.726552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.726810 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:38.727052 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:38.727559 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 22:49:38.727798 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:49:38.729749 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24254
I20260809 22:49:38.743038 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.730756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59128 (local address 127.23.131.65:40897)
0809 22:49:38.730925 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.730929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.731339 (+ 410us) server_negotiation.cc:407] Connection header received
0809 22:49:38.731460 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.731464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.731519 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.731597 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.732967 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.733669 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.734917 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.735396 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.735525 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.738111 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:38.738116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:38.738119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:38.738148 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:38.740850 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.741450 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.741453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.741456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.741584 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.741886 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.741889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.741891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.742153 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:38.742334 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:38.742592 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 22:49:38.742777 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 22:49:38.743795 24444 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:38.831534 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24254
I20260809 22:49:38.858307 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24459
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:49:38.875022 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.859272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47660 (local address 127.23.131.66:46769)
0809 22:49:38.859908 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.859915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.859942 (+ 27us) server_negotiation.cc:407] Connection header received
0809 22:49:38.860012 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.860019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.860225 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.860356 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.861628 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.862669 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.864132 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.864695 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.864796 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:38.868936 (+ 4140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:38.868951 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:38.868966 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:38.869003 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:38.872430 (+ 3427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.873130 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.873137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.873139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.873270 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:38.873658 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:38.873661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:38.873663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:38.874007 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:38.874264 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:38.874507 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 22:49:38.874718 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":340,"threads_started":1}
I20260809 22:49:38.876444 24644 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:38.965920 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24459
I20260809 22:49:38.991816 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24667
Aug 09 22:49:38 dist-test-slave-92m1 krb5kdc[24088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:49:39.008733 24903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:38.992901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.23.131.67:41921)
0809 22:49:38.993586 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:38.993593 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:38.993623 (+ 30us) server_negotiation.cc:407] Connection header received
0809 22:49:38.993683 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:38.993689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:38.993901 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:38.994093 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:38.995468 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.996525 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.997783 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:38.998373 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:38.998524 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:39.002748 (+ 4224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:39.002760 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:39.002775 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:39.002814 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:39.005699 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:39.006400 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:39.006408 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:39.006410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:39.006545 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:39.006926 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:39.006931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:39.006935 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:39.007391 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:39.007736 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:39.008079 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 22:49:39.008373 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":353,"threads_started":1}
I20260809 22:49:39.010051 24867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:39.096890 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24667
I20260809 22:49:39.125224 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24105
I20260809 22:49:39.126513 24201 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:39.235664 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24105
2026-08-09T22:49:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4552 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:49:39 dist-test-slave-92m1 krb5kdc[24914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:49:39 dist-test-slave-92m1 krb5kdc[24914](info): set up 2 sockets
Aug 09 22:49:39 dist-test-slave-92m1 krb5kdc[24914](info): commencing operation
krb5kdc: starting...
W20260809 22:49:40.572449 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:49:40 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:49:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:49:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:49:40.796960 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45865
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:41.145565 24933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:41.145929 24933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:41.146122 24933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:41.153396 24933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:49:41.153548 24933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:41.153659 24933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:41.153769 24933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:49:41.153860 24933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:49:41.163662 24933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:41.165007 24933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:41.166326 24933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:41.178764 24940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:41.178725 24943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:41.178699 24941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:41.179617 24933 server_base.cc:1034] running on GCE node
I20260809 22:49:41.180495 24933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:41.181964 24933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:41.183254 24933 hybrid_clock.cc:648] HybridClock initialized: now 1786315781183159 us; error 60 us; skew 500 ppm
I20260809 22:49:41.183629 24933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:41 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315781, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:41.191042 24933 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:49:41.192754 24933 webserver.cc:460] Webserver started at http://127.23.131.126:39173/ using document root <none> and password file <none>
I20260809 22:49:41.193499 24933 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:41.193655 24933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:41.194000 24933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:41.197234 24933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "cdcd2598c114452083c255778f382368"
format_stamp: "Formatted at 2026-08-09 22:49:41 on dist-test-slave-92m1"
server_key: "8755d8a4a7414191d9c2915638d33f64"
server_key_iv: "88f2d40f131436e153a013587cf8701d"
server_key_version: "encryptionkey@0"
I20260809 22:49:41.198055 24933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "cdcd2598c114452083c255778f382368"
format_stamp: "Formatted at 2026-08-09 22:49:41 on dist-test-slave-92m1"
server_key: "8755d8a4a7414191d9c2915638d33f64"
server_key_iv: "88f2d40f131436e153a013587cf8701d"
server_key_version: "encryptionkey@0"
I20260809 22:49:41.203508 24933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260809 22:49:41.206946 24955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:41.208278 24933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:49:41.208469 24933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "cdcd2598c114452083c255778f382368"
format_stamp: "Formatted at 2026-08-09 22:49:41 on dist-test-slave-92m1"
server_key: "8755d8a4a7414191d9c2915638d33f64"
server_key_iv: "88f2d40f131436e153a013587cf8701d"
server_key_version: "encryptionkey@0"
I20260809 22:49:41.208675 24933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:41.229709 24933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:41.234400 24933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:41.234741 24933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:41.254786 24933 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:45865
I20260809 22:49:41.254822 25032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:45865 every 8 connection(s)
I20260809 22:49:41.256378 24933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:49:41.260391 25034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:41.261227 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24933
I20260809 22:49:41.261492 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:49:41.262403 24077 external_mini_cluster.cc:1428] Setting key ad7ff28e8d6b6bbbf3e8bb7c12f9154e
I20260809 22:49:41.276476 25034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368: Bootstrap starting.
Aug 09 22:49:41 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:41.280779 25034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:41.282299 25034 log.cc:824] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:41.286075 25034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368: No bootstrap required, opened a new log
I20260809 22:49:41.289398 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:41.264744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59874 (local address 127.23.131.126:45865)
0809 22:49:41.265575 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:41.265587 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:41.265630 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:49:41.267624 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:41.267650 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:41.268081 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:41.268499 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:41.270584 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:41.272473 (+ 1889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:41.274372 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:41.275110 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:41.275338 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:41.280365 (+ 5027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:41.280379 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:41.280401 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:41.280523 (+ 122us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:41.284569 (+ 4046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:41.285306 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:41.285314 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:41.285323 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:41.285533 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:41.285896 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:41.285901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:41.285904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:41.286702 (+ 798us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:41.287020 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:41.287473 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 22:49:41.287928 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":374,"threads_started":1}
I20260809 22:49:41.295692 25034 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcd2598c114452083c255778f382368" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45865 } }
I20260809 22:49:41.296087 25034 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:41.296214 25034 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdcd2598c114452083c255778f382368, State: Initialized, Role: FOLLOWER
I20260809 22:49:41.297001 25034 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcd2598c114452083c255778f382368" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45865 } }
I20260809 22:49:41.297358 25034 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:49:41.297513 25034 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:49:41.297690 25034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:41.300026 25034 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcd2598c114452083c255778f382368" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45865 } }
I20260809 22:49:41.300508 25034 leader_election.cc:302] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdcd2598c114452083c255778f382368; no voters:
I20260809 22:49:41.301074 25034 leader_election.cc:288] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:49:41.301257 25040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:41.301986 25040 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [term 1 LEADER]: Becoming Leader. State: Replica: cdcd2598c114452083c255778f382368, State: Running, Role: LEADER
I20260809 22:49:41.302584 25040 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcd2598c114452083c255778f382368" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45865 } }
I20260809 22:49:41.303339 25034 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:49:41.306035 25041 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdcd2598c114452083c255778f382368" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcd2598c114452083c255778f382368" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45865 } } }
I20260809 22:49:41.306579 25041 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:41.307418 25043 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdcd2598c114452083c255778f382368. Latest consensus state: current_term: 1 leader_uuid: "cdcd2598c114452083c255778f382368" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcd2598c114452083c255778f382368" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45865 } } }
I20260809 22:49:41.307849 25043 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368 [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:41.308705 25051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:49:41.314587 25051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:49:41.324354 25051 catalog_manager.cc:1347] Generated new cluster ID: 12ec4d71fa104a82bdeb7d31b0e8565c
I20260809 22:49:41.324514 25051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:49:41.363086 25051 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:49:41.364530 25051 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:49:41.377079 25051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdcd2598c114452083c255778f382368: Generated new TSK 0
I20260809 22:49:41.377965 25051 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:49:41.434535 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45865
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:41.790674 25072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:41.790989 25072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:41.791092 25072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:41.799664 25072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:41.799794 25072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:41.799919 25072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:49:41.810434 25072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45865
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:41.811790 25072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:41.813265 25072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:41.827673 25078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:41.827723 25082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:41.827723 25079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:41.829250 25072 server_base.cc:1034] running on GCE node
I20260809 22:49:41.829898 25072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:41.830886 25072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:41.832137 25072 hybrid_clock.cc:648] HybridClock initialized: now 1786315781832075 us; error 57 us; skew 500 ppm
I20260809 22:49:41.832499 25072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:41 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315781, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:41.836026 25072 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:49:41.837749 25072 webserver.cc:460] Webserver started at http://127.23.131.65:41339/ using document root <none> and password file <none>
I20260809 22:49:41.838508 25072 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:41.838673 25072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:41.839022 25072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:41.842217 25072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "04b87538ffed483a8b6583b0fd3b6866"
format_stamp: "Formatted at 2026-08-09 22:49:41 on dist-test-slave-92m1"
server_key: "ee6f7b2802e9052ceb21b750bcb761c2"
server_key_iv: "b783a9a64e9b748bd81509dc61693c2d"
server_key_version: "encryptionkey@0"
I20260809 22:49:41.843132 25072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "04b87538ffed483a8b6583b0fd3b6866"
format_stamp: "Formatted at 2026-08-09 22:49:41 on dist-test-slave-92m1"
server_key: "ee6f7b2802e9052ceb21b750bcb761c2"
server_key_iv: "b783a9a64e9b748bd81509dc61693c2d"
server_key_version: "encryptionkey@0"
I20260809 22:49:41.848860 25072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:49:41.852592 25094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:41.853924 25072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:49:41.854127 25072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "04b87538ffed483a8b6583b0fd3b6866"
format_stamp: "Formatted at 2026-08-09 22:49:41 on dist-test-slave-92m1"
server_key: "ee6f7b2802e9052ceb21b750bcb761c2"
server_key_iv: "b783a9a64e9b748bd81509dc61693c2d"
server_key_version: "encryptionkey@0"
I20260809 22:49:41.854362 25072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:41.875262 25072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:41.879978 25072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:41.880306 25072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:41.881328 25072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:49:41.882709 25072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:41.882822 25072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:41.882970 25072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:41.883042 25072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:41.919433 25072 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:39273
I20260809 22:49:41.919521 25273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:39273 every 8 connection(s)
I20260809 22:49:41.920818 25072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:49:41.929205 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25072
I20260809 22:49:41.929454 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:49:41.930110 24077 external_mini_cluster.cc:1428] Setting key c445510228c32f06c10b9d7a969d4be8
Aug 09 22:49:41 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315781, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:41.942270 25282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:41.923518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:56573 (local address 127.23.131.126:45865)
0809 22:49:41.923996 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:41.924001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:41.925096 (+ 1095us) server_negotiation.cc:407] Connection header received
0809 22:49:41.927082 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:41.927088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:41.927185 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:41.927374 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:41.929080 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:41.929955 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:41.931835 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:41.932379 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:41.932535 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:41.936380 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:41.936386 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:41.936389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:41.936422 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:41.938952 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:41.939820 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:41.939826 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:41.939830 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:41.939962 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:41.940430 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:41.940438 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:41.940445 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:41.940728 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:41.940893 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:41.941643 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 22:49:41.941890 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":243,"threads_started":1}
I20260809 22:49:41.943372 25283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:41.924162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45865 (local address 127.23.131.65:56573)
0809 22:49:41.924907 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:41.924955 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:41.926780 (+ 1825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:41.927659 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:41.927668 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:41.928233 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:41.928851 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:41.928892 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:41.930132 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:41.930136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:41.931679 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:41.931693 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:41.932659 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:41.932669 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:41.932920 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:41.933649 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:41.933674 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:41.936082 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:41.939119 (+ 3037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:41.939128 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:41.939148 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:41.939683 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:41.940081 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:41.940089 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:41.940093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:41.940303 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:41.940866 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:41.940874 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:41.941245 (+ 371us) client_negotiation.cc:769] Sending connection context
0809 22:49:41.941520 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 22:49:41.942096 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":279,"threads_started":1}
I20260809 22:49:41.945149 25276 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45865
I20260809 22:49:41.945480 25276 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:41.946235 25276 heartbeater.cc:511] Master 127.23.131.126:45865 requested a full tablet report, sending...
I20260809 22:49:41.948844 24984 ts_manager.cc:194] Registered new tserver with Master: 04b87538ffed483a8b6583b0fd3b6866 (127.23.131.65:39273)
I20260809 22:49:41.951267 24984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:56573
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:49:41.982661 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45865
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:42.334964 25288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:42.335361 25288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:42.335541 25288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:42.343042 25288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:42.343165 25288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:42.343416 25288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:49:42.353649 25288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45865
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:42.355062 25288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:42.356489 25288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:42.370580 25301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:42.370546 25298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:42.371160 25295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:42.371482 25288 server_base.cc:1034] running on GCE node
I20260809 22:49:42.372128 25288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:42.373157 25288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:42.374418 25288 hybrid_clock.cc:648] HybridClock initialized: now 1786315782374339 us; error 60 us; skew 500 ppm
I20260809 22:49:42.374768 25288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:42 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315782, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:42.378244 25288 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:49:42.379885 25288 webserver.cc:460] Webserver started at http://127.23.131.66:41147/ using document root <none> and password file <none>
I20260809 22:49:42.380573 25288 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:42.380678 25288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:42.380961 25288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:42.383985 25288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "e1a049910e55470696d27fbb343c09b6"
format_stamp: "Formatted at 2026-08-09 22:49:42 on dist-test-slave-92m1"
server_key: "9046e7de431e301191aa73d78e54007d"
server_key_iv: "9df72c64615fe5558aba55bf04bcd492"
server_key_version: "encryptionkey@0"
I20260809 22:49:42.384780 25288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "e1a049910e55470696d27fbb343c09b6"
format_stamp: "Formatted at 2026-08-09 22:49:42 on dist-test-slave-92m1"
server_key: "9046e7de431e301191aa73d78e54007d"
server_key_iv: "9df72c64615fe5558aba55bf04bcd492"
server_key_version: "encryptionkey@0"
I20260809 22:49:42.390206 25288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:49:42.394016 25310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:42.395525 25288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:49:42.395704 25288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "e1a049910e55470696d27fbb343c09b6"
format_stamp: "Formatted at 2026-08-09 22:49:42 on dist-test-slave-92m1"
server_key: "9046e7de431e301191aa73d78e54007d"
server_key_iv: "9df72c64615fe5558aba55bf04bcd492"
server_key_version: "encryptionkey@0"
I20260809 22:49:42.395911 25288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:42.414072 25288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:42.418602 25288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:42.418918 25288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:42.419963 25288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:49:42.421335 25288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:42.421411 25288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:42.421603 25288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:42.421657 25288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:42.457444 25288 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:37409
I20260809 22:49:42.457463 25489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:37409 every 8 connection(s)
I20260809 22:49:42.458987 25288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:49:42.467386 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25288
I20260809 22:49:42.467607 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:49:42.468118 24077 external_mini_cluster.cc:1428] Setting key ba6ccdf469341a3bbb8059fda47e2a57
Aug 09 22:49:42 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315782, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:42.480657 25494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:42.461785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:60271 (local address 127.23.131.126:45865)
0809 22:49:42.462305 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:42.462312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:42.463387 (+ 1075us) server_negotiation.cc:407] Connection header received
0809 22:49:42.465242 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:42.465246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:42.465318 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:42.465421 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:42.466998 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:42.467906 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:42.469810 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:42.470303 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:42.470447 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:42.474418 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:42.474423 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:42.474427 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:42.474461 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:42.477219 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:42.478058 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:42.478067 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:42.478075 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:42.478220 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:42.478704 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:42.478710 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:42.478715 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:42.479020 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:42.479202 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:42.480013 (+ 811us) server_negotiation.cc:299] Negotiation successful
0809 22:49:42.480275 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":246,"threads_started":1}
I20260809 22:49:42.481801 25496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:42.462421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45865 (local address 127.23.131.66:60271)
0809 22:49:42.463169 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:42.463259 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:42.464969 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:42.465648 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:42.465656 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:42.466198 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:42.466796 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:42.466815 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:42.468077 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:42.468082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:42.469640 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:42.469653 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:42.470578 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:42.470589 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:42.470824 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:42.471591 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:42.471622 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:42.474159 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:42.477388 (+ 3229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:42.477398 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:42.477418 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:42.477910 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:42.478347 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:42.478352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:42.478356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:42.478577 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:42.479192 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:42.479228 (+ 36us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:42.479618 (+ 390us) client_negotiation.cc:769] Sending connection context
0809 22:49:42.479924 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 22:49:42.480516 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":296,"threads_started":1}
I20260809 22:49:42.483713 25490 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45865
I20260809 22:49:42.484074 25490 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:42.484941 25490 heartbeater.cc:511] Master 127.23.131.126:45865 requested a full tablet report, sending...
I20260809 22:49:42.486763 24984 ts_manager.cc:194] Registered new tserver with Master: e1a049910e55470696d27fbb343c09b6 (127.23.131.66:37409)
I20260809 22:49:42.488153 24984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:60271
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:49:42.520702 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45865
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:42.870118 25501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:42.870433 25501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:42.870538 25501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:42.878221 25501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:42.878350 25501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:42.878472 25501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:49:42.888765 25501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45865
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:42.890139 25501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:42.891680 25501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:42.905725 25508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:42.905754 25509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:42.906394 25511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:42.906350 25501 server_base.cc:1034] running on GCE node
I20260809 22:49:42.907121 25501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:42.908063 25501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:42.909317 25501 hybrid_clock.cc:648] HybridClock initialized: now 1786315782909251 us; error 59 us; skew 500 ppm
I20260809 22:49:42.909627 25501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:42 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315782, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:42.912983 25501 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:49:42.914467 25501 webserver.cc:460] Webserver started at http://127.23.131.67:37579/ using document root <none> and password file <none>
I20260809 22:49:42.915138 25501 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:42.915309 25501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:42.915589 25501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:42.918426 25501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5"
format_stamp: "Formatted at 2026-08-09 22:49:42 on dist-test-slave-92m1"
server_key: "a84581202754bd512a9175027803184e"
server_key_iv: "c5276bb6442dfd677f35c676977feb0c"
server_key_version: "encryptionkey@0"
I20260809 22:49:42.919317 25501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5"
format_stamp: "Formatted at 2026-08-09 22:49:42 on dist-test-slave-92m1"
server_key: "a84581202754bd512a9175027803184e"
server_key_iv: "c5276bb6442dfd677f35c676977feb0c"
server_key_version: "encryptionkey@0"
I20260809 22:49:42.924463 25501 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:49:42.927995 25522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:42.929296 25501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:49:42.929466 25501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5"
format_stamp: "Formatted at 2026-08-09 22:49:42 on dist-test-slave-92m1"
server_key: "a84581202754bd512a9175027803184e"
server_key_iv: "c5276bb6442dfd677f35c676977feb0c"
server_key_version: "encryptionkey@0"
I20260809 22:49:42.929685 25501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:42.954547 25276 heartbeater.cc:503] Master 127.23.131.126:45865 was elected leader, sending a full tablet report...
I20260809 22:49:42.958109 25501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:42.962776 25501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:42.963116 25501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:42.964164 25501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:49:42.965636 25501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:42.965710 25501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:42.965883 25501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:42.965935 25501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:43.005968 25501 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:36713
I20260809 22:49:43.006065 25705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:36713 every 8 connection(s)
I20260809 22:49:43.007395 25501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:49:43.014819 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25501
I20260809 22:49:43.015021 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:49:43.015528 24077 external_mini_cluster.cc:1428] Setting key 826fab0a0d7e977b00bb5f2852293264
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315782, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:43.028126 25711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.010225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:45659 (local address 127.23.131.126:45865)
0809 22:49:43.010736 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.010741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.011722 (+ 981us) server_negotiation.cc:407] Connection header received
0809 22:49:43.013732 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.013737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.013844 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.013973 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.015636 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.016636 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.018374 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.018773 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.018914 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.022462 (+ 3548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.022466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.022469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.022500 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.025268 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.025959 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.025963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.025965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.026079 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.026605 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.026609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.026611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.026878 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.027001 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.027681 (+ 680us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.027842 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":244,"threads_started":1}
I20260809 22:49:43.029189 25713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.010769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45865 (local address 127.23.131.67:45659)
0809 22:49:43.011566 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.011604 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:43.013474 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:43.014191 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:43.014199 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:43.014727 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:43.015470 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.015489 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.016786 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.016791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.018230 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.018242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.019004 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.019014 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.019327 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.020074 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:43.020097 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:43.022285 (+ 2188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:43.025392 (+ 3107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:43.025399 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:43.025409 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:43.025831 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:43.026169 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:43.026173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:43.026175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:43.026355 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:43.026986 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:43.026991 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:43.027358 (+ 367us) client_negotiation.cc:769] Sending connection context
0809 22:49:43.027579 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 22:49:43.027944 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":305,"threads_started":1}
I20260809 22:49:43.030732 25707 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45865
I20260809 22:49:43.031075 25707 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:43.031808 25707 heartbeater.cc:511] Master 127.23.131.126:45865 requested a full tablet report, sending...
I20260809 22:49:43.033248 24984 ts_manager.cc:194] Registered new tserver with Master: 9908f7ec0c1a4d6e9794cbbc6173cde5 (127.23.131.67:36713)
I20260809 22:49:43.034018 24984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:45659
I20260809 22:49:43.043182 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:49:43.062433 25711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.049777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59886 (local address 127.23.131.126:45865)
0809 22:49:43.049967 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.049971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.050452 (+ 481us) server_negotiation.cc:407] Connection header received
0809 22:49:43.050598 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.050603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.050666 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.050750 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.052373 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.053124 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.054425 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.054832 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.054917 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.057404 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.057409 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.057412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.057461 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.060229 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.060823 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.060827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.060829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.060942 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.061256 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.061259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.061260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.061557 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.061730 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.062039 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.062214 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 22:49:43.068894 24984 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59886:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:43.075767 24984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:43.100310 25726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.088109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39273 (local address 127.0.0.1:59488)
0809 22:49:43.089596 (+ 1487us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.089647 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:43.089828 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:43.091839 (+ 2011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:43.091849 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:43.091882 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:43.092391 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.092409 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.094817 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.094824 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.097214 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.097229 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.099242 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.099250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.099446 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.099505 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 22:49:43.099608 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 22:49:43.099913 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1203,"thread_start_us":1079,"threads_started":1}
I20260809 22:49:43.101650 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.088389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.23.131.65:39273)
0809 22:49:43.091167 (+ 2778us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.091177 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.091247 (+ 70us) server_negotiation.cc:407] Connection header received
0809 22:49:43.091364 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.091372 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.091605 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.093374 (+ 1769us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:43.093622 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.094676 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.097376 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.098993 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.099734 (+ 741us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.099984 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.100080 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.100254 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2602,"thread_start_us":2434,"threads_started":1}
I20260809 22:49:43.101893 25727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.088358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:36713 (local address 127.0.0.1:35818)
0809 22:49:43.090906 (+ 2548us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.090945 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:43.091087 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:43.092120 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:43.092127 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:43.092151 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:43.093095 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.093109 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.096705 (+ 3596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.096710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.098541 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.098561 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.100949 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.100962 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.101134 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.101170 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 22:49:43.101265 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 22:49:43.101409 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2408,"mutex_wait_us":20,"thread_start_us":2257,"threads_started":1}
I20260809 22:49:43.102335 25731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.091527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.23.131.66:37409)
0809 22:49:43.093274 (+ 1747us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.093281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.093310 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:49:43.093510 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.093516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.093736 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.093928 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:43.094532 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.096078 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.098925 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.100515 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.100682 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.100878 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.101895 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.102085 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1577,"thread_start_us":858,"threads_started":1}
I20260809 22:49:43.102723 25729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.089118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.23.131.67:36713)
0809 22:49:43.090610 (+ 1492us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.090633 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.091240 (+ 607us) server_negotiation.cc:407] Connection header received
0809 22:49:43.091365 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.091372 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.091602 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.091799 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:43.094942 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.096591 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.098794 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.100435 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.100572 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.100786 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.102178 (+ 1392us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.102353 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1280,"thread_start_us":1030,"threads_started":1}
I20260809 22:49:43.102933 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.091046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:37409 (local address 127.0.0.1:46144)
0809 22:49:43.093181 (+ 2135us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.093199 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:43.093315 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:43.093929 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:43.093934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:43.093958 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:43.094313 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.094322 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.096262 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.096267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.098731 (+ 2464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.098747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.101037 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.101043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.101225 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.101262 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 22:49:43.101348 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 22:49:43.101481 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1992,"mutex_wait_us":98,"thread_start_us":1795,"threads_started":1}
I20260809 22:49:43.106154 25608 tablet_service.cc:1467] Processing CreateTablet for tablet eeba2e2177204a5184be0d9e067674e4 (DEFAULT_TABLE table=test-table [id=8bb425e810814611876b5583304a8a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:43.106061 25166 tablet_service.cc:1467] Processing CreateTablet for tablet eeba2e2177204a5184be0d9e067674e4 (DEFAULT_TABLE table=test-table [id=8bb425e810814611876b5583304a8a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:43.106508 25386 tablet_service.cc:1467] Processing CreateTablet for tablet eeba2e2177204a5184be0d9e067674e4 (DEFAULT_TABLE table=test-table [id=8bb425e810814611876b5583304a8a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:43.107672 25608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeba2e2177204a5184be0d9e067674e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:43.107745 25166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeba2e2177204a5184be0d9e067674e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:43.107779 25386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeba2e2177204a5184be0d9e067674e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:43.121176 25733 tablet_bootstrap.cc:492] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: Bootstrap starting.
I20260809 22:49:43.123193 25734 tablet_bootstrap.cc:492] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: Bootstrap starting.
I20260809 22:49:43.125380 25733 tablet_bootstrap.cc:654] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:43.126793 25733 log.cc:824] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:43.126866 25734 tablet_bootstrap.cc:654] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:43.127748 25735 tablet_bootstrap.cc:492] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: Bootstrap starting.
I20260809 22:49:43.128399 25734 log.cc:824] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:43.131489 25735 tablet_bootstrap.cc:654] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:43.131523 25733 tablet_bootstrap.cc:492] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: No bootstrap required, opened a new log
I20260809 22:49:43.131793 25733 ts_tablet_manager.cc:1397] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260809 22:49:43.131999 25734 tablet_bootstrap.cc:492] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: No bootstrap required, opened a new log
I20260809 22:49:43.132259 25734 ts_tablet_manager.cc:1397] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260809 22:49:43.132779 25735 log.cc:824] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:43.136090 25735 tablet_bootstrap.cc:492] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: No bootstrap required, opened a new log
I20260809 22:49:43.136369 25735 ts_tablet_manager.cc:1397] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260809 22:49:43.140354 25733 raft_consensus.cc:348] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.140767 25733 raft_consensus.cc:374] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:43.140897 25733 raft_consensus.cc:729] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9908f7ec0c1a4d6e9794cbbc6173cde5, State: Initialized, Role: FOLLOWER
I20260809 22:49:43.141552 25733 consensus_queue.cc:260] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.142670 25707 heartbeater.cc:503] Master 127.23.131.126:45865 was elected leader, sending a full tablet report...
I20260809 22:49:43.143007 25734 raft_consensus.cc:348] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.143409 25733 ts_tablet_manager.cc:1428] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260809 22:49:43.143497 25734 raft_consensus.cc:374] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:43.143594 25734 raft_consensus.cc:729] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04b87538ffed483a8b6583b0fd3b6866, State: Initialized, Role: FOLLOWER
I20260809 22:49:43.144177 25734 consensus_queue.cc:260] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.145897 25734 ts_tablet_manager.cc:1428] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 22:49:43.147432 25735 raft_consensus.cc:348] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.147804 25735 raft_consensus.cc:374] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:43.147949 25735 raft_consensus.cc:729] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a049910e55470696d27fbb343c09b6, State: Initialized, Role: FOLLOWER
I20260809 22:49:43.148581 25735 consensus_queue.cc:260] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.149762 25490 heartbeater.cc:503] Master 127.23.131.126:45865 was elected leader, sending a full tablet report...
I20260809 22:49:43.150353 25735 ts_tablet_manager.cc:1428] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260809 22:49:43.173386 25278 tablet.cc:2369] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:49:43.211391 25493 tablet.cc:2369] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:49:43.259166 25708 tablet.cc:2369] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:49:43.347330 25739 raft_consensus.cc:482] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:43.347684 25739 raft_consensus.cc:504] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.349470 25739 leader_election.cc:288] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04b87538ffed483a8b6583b0fd3b6866 (127.23.131.65:39273), e1a049910e55470696d27fbb343c09b6 (127.23.131.66:37409)
I20260809 22:49:43.356460 25713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.349839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39273 (local address 127.23.131.67:46867)
0809 22:49:43.350169 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.350190 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:43.350348 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:43.350803 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:43.350810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:43.350844 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:43.351072 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.351083 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.352347 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.352350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.354327 (+ 1977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.354341 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.355781 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.355785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.355921 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.355947 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 22:49:43.356023 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 22:49:43.356113 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260809 22:49:43.356479 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.349969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:46867 (local address 127.23.131.65:39273)
0809 22:49:43.350192 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.350199 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.350249 (+ 50us) server_negotiation.cc:407] Connection header received
0809 22:49:43.350548 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.350555 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.350647 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.350742 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:43.351247 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.352223 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.354485 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.355636 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.355811 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.355892 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.356085 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.356214 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:49:43.357270 25731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.349976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:60529 (local address 127.23.131.66:37409)
0809 22:49:43.350253 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.350262 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.350886 (+ 624us) server_negotiation.cc:407] Connection header received
0809 22:49:43.351093 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.351097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.351190 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.351313 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:43.351820 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.352714 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.354918 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.356190 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.356350 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.356415 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.356883 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.357023 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 22:49:43.357357 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.349951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:37409 (local address 127.23.131.67:60529)
0809 22:49:43.350763 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.350780 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:43.350951 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:43.351335 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:43.351338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:43.351371 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:43.351674 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.351682 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.352872 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.352878 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.354761 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:43.354771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.356508 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.356515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:43.356696 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.356741 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 22:49:43.356836 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 22:49:43.356970 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"spinlock_wait_cycles":32640,"thread_start_us":451,"threads_started":1}
I20260809 22:49:43.357585 25195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeba2e2177204a5184be0d9e067674e4" candidate_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b87538ffed483a8b6583b0fd3b6866" is_pre_election: true
I20260809 22:49:43.358270 25195 raft_consensus.cc:2454] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9908f7ec0c1a4d6e9794cbbc6173cde5 in term 0.
I20260809 22:49:43.358320 25417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeba2e2177204a5184be0d9e067674e4" candidate_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a049910e55470696d27fbb343c09b6" is_pre_election: true
I20260809 22:49:43.358880 25417 raft_consensus.cc:2454] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9908f7ec0c1a4d6e9794cbbc6173cde5 in term 0.
I20260809 22:49:43.359035 25524 leader_election.cc:302] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04b87538ffed483a8b6583b0fd3b6866, 9908f7ec0c1a4d6e9794cbbc6173cde5; no voters:
I20260809 22:49:43.359534 25739 raft_consensus.cc:2781] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:43.359748 25739 raft_consensus.cc:482] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:43.359900 25739 raft_consensus.cc:3037] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:43.362176 25739 raft_consensus.cc:504] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.362836 25739 leader_election.cc:288] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [CANDIDATE]: Term 1 election: Requested vote from peers 04b87538ffed483a8b6583b0fd3b6866 (127.23.131.65:39273), e1a049910e55470696d27fbb343c09b6 (127.23.131.66:37409)
I20260809 22:49:43.363379 25195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeba2e2177204a5184be0d9e067674e4" candidate_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b87538ffed483a8b6583b0fd3b6866"
I20260809 22:49:43.363370 25417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeba2e2177204a5184be0d9e067674e4" candidate_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a049910e55470696d27fbb343c09b6"
I20260809 22:49:43.363613 25417 raft_consensus.cc:3037] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:43.363613 25195 raft_consensus.cc:3037] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:43.367066 25417 raft_consensus.cc:2454] T eeba2e2177204a5184be0d9e067674e4 P e1a049910e55470696d27fbb343c09b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9908f7ec0c1a4d6e9794cbbc6173cde5 in term 1.
I20260809 22:49:43.367054 25195 raft_consensus.cc:2454] T eeba2e2177204a5184be0d9e067674e4 P 04b87538ffed483a8b6583b0fd3b6866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9908f7ec0c1a4d6e9794cbbc6173cde5 in term 1.
I20260809 22:49:43.367542 25524 leader_election.cc:302] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04b87538ffed483a8b6583b0fd3b6866, 9908f7ec0c1a4d6e9794cbbc6173cde5; no voters:
I20260809 22:49:43.367846 25739 raft_consensus.cc:2781] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:43.368320 25739 raft_consensus.cc:686] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9908f7ec0c1a4d6e9794cbbc6173cde5, State: Running, Role: LEADER
I20260809 22:49:43.368836 25739 consensus_queue.cc:237] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } }
I20260809 22:49:43.373787 24984 catalog_manager.cc:5495] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9908f7ec0c1a4d6e9794cbbc6173cde5 (127.23.131.67). New cstate: current_term: 1 leader_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b87538ffed483a8b6583b0fd3b6866" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9908f7ec0c1a4d6e9794cbbc6173cde5" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a049910e55470696d27fbb343c09b6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 37409 } health_report { overall_health: UNKNOWN } } }
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:43.401520 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.385917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59490 (local address 127.23.131.65:39273)
0809 22:49:43.386098 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.386103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.386668 (+ 565us) server_negotiation.cc:407] Connection header received
0809 22:49:43.386887 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.386891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.386985 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.387100 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.388782 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.389560 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.390861 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.391375 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.391529 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.395890 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.395907 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.395923 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.395967 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.398759 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.399526 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.399536 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.399539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.399702 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.400125 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.400128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.400130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.400525 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.400801 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.401073 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.401246 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315783, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315783, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:43.459607 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.444245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59496 (local address 127.23.131.65:39273)
0809 22:49:43.444490 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.444499 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.444942 (+ 443us) server_negotiation.cc:407] Connection header received
0809 22:49:43.445154 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.445159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.445228 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.445341 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.446965 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.447827 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.449115 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.449549 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.449695 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.453943 (+ 4248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.453949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.453953 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.453993 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.456618 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.457437 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.457441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.457443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.457580 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.458064 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.458067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.458069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.458421 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.458649 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.458957 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.459236 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:43.517755 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.503174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59512 (local address 127.23.131.65:39273)
0809 22:49:43.503467 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.503476 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.503828 (+ 352us) server_negotiation.cc:407] Connection header received
0809 22:49:43.504074 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.504078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.504144 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.504275 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.505835 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.506547 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.507903 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.508356 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.508503 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.512748 (+ 4245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.512754 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.512757 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.512795 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.515486 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.516129 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.516133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.516135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.516253 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.516569 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.516573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.516575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.516874 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.517079 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.517305 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.517488 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
W20260809 22:49:43.519609 25136 tablet_service.cc:2908] Rejecting scan request for tablet eeba2e2177204a5184be0d9e067674e4: Uninitialized: clean time has not yet been initialized
I20260809 22:49:43.523382 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25072
I20260809 22:49:43.537299 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.524684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59516 (local address 127.23.131.65:39273)
0809 22:49:43.524857 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.524861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.525306 (+ 445us) server_negotiation.cc:407] Connection header received
0809 22:49:43.525449 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.525452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.525524 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.525610 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.526770 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.527536 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.528974 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.529375 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.529568 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.532265 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.532270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.532273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.532306 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.534974 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.535684 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.535688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.535690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.535808 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.536156 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.536159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.536161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.536446 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.536663 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.536894 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.537059 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 22:49:43.537979 25264 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:43.641415 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25072
I20260809 22:49:43.669572 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25288
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:49:43.684938 25731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.670440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.23.131.66:37409)
0809 22:49:43.670668 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.670674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.670695 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:49:43.670872 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.670876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.670956 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.671067 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.672334 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.673146 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.674461 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.674875 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.675021 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.679151 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.679169 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.679185 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.679262 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.681938 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.682646 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.682661 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.682664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.682800 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.683291 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.683297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.683299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.683679 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.684022 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.684344 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.684607 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:49:43.685664 25483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:43.775882 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25288
I20260809 22:49:43.803288 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25501
Aug 09 22:49:43 dist-test-slave-92m1 krb5kdc[24914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:49:43.818769 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.818257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39273 (local address 127.23.131.67:45309)
0809 22:49:43.818436 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.818566 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:39273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 22:49:43.819068 25772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.804128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.23.131.67:36713)
0809 22:49:43.804598 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:43.804604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:43.804634 (+ 30us) server_negotiation.cc:407] Connection header received
0809 22:49:43.804691 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:43.804695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:43.804756 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:43.804848 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:43.806093 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.806781 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.808116 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:43.808513 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:43.808661 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:43.813002 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:43.813018 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:43.813034 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:43.813068 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:43.816044 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.816705 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.816713 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.816715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.816865 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:43.817227 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:43.817231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:43.817233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:43.817732 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:43.818050 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:43.818366 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 22:49:43.818616 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":240,"threads_started":1}
W20260809 22:49:43.819100 25524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.65:39273: connect: Connection refused (error 111)
I20260809 22:49:43.820515 25700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:43.912199 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.820434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39273 (local address 127.23.131.67:33501)
0809 22:49:43.820625 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.820729 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:39273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 22:49:43.912504 25524 consensus_peers.cc:487] T eeba2e2177204a5184be0d9e067674e4 P 9908f7ec0c1a4d6e9794cbbc6173cde5 -> Peer 04b87538ffed483a8b6583b0fd3b6866 (127.23.131.65:39273): Couldn't send request to peer 04b87538ffed483a8b6583b0fd3b6866. Status: Network error: Client connection negotiation failed: client connection to 127.23.131.65:39273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 22:49:43.913105 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:43.912518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:37409 (local address 127.23.131.67:40817)
0809 22:49:43.912732 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:43.912864 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.66:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 22:49:43.914023 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25501
I20260809 22:49:43.941170 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24933
I20260809 22:49:43.942399 25026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:44.056525 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24933
2026-08-09T22:49:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4821 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:49:44 dist-test-slave-92m1 krb5kdc[25789](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:49:44 dist-test-slave-92m1 krb5kdc[25789](info): set up 2 sockets
Aug 09 22:49:44 dist-test-slave-92m1 krb5kdc[25789](info): commencing operation
krb5kdc: starting...
W20260809 22:49:45.410238 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:49:45 dist-test-slave-92m1 krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:49:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:49:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:49:45.662575 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41517
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:46.018759 25805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:46.019122 25805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:46.019312 25805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:46.026919 25805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:49:46.027072 25805 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 22:49:46.027118 25805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:46.027186 25805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:46.027348 25805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:49:46.027424 25805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:49:46.037809 25805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41517
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:46.039120 25805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:46.040442 25805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:46.052898 25814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:46.052940 25818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:46.052861 25816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:46.054044 25805 server_base.cc:1034] running on GCE node
I20260809 22:49:46.054924 25805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:46.056502 25805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:46.057740 25805 hybrid_clock.cc:648] HybridClock initialized: now 1786315786057676 us; error 31 us; skew 500 ppm
I20260809 22:49:46.058131 25805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:46 dist-test-slave-92m1 krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315786, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:46.061465 25805 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:49:46.063071 25805 webserver.cc:460] Webserver started at http://127.23.131.126:44385/ using document root <none> and password file <none>
I20260809 22:49:46.063858 25805 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:46.064006 25805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:46.064359 25805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:46.067615 25805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "e90055b6ca50475b9f31a279601921da"
format_stamp: "Formatted at 2026-08-09 22:49:46 on dist-test-slave-92m1"
server_key: "8c939a6d47748352bd2f50bc8e793a71"
server_key_iv: "f63304878cc621103ca8175248cf6585"
server_key_version: "encryptionkey@0"
I20260809 22:49:46.068477 25805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "e90055b6ca50475b9f31a279601921da"
format_stamp: "Formatted at 2026-08-09 22:49:46 on dist-test-slave-92m1"
server_key: "8c939a6d47748352bd2f50bc8e793a71"
server_key_iv: "f63304878cc621103ca8175248cf6585"
server_key_version: "encryptionkey@0"
I20260809 22:49:46.074564 25805 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 22:49:46.078469 25831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:46.079931 25805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:49:46.080166 25805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "e90055b6ca50475b9f31a279601921da"
format_stamp: "Formatted at 2026-08-09 22:49:46 on dist-test-slave-92m1"
server_key: "8c939a6d47748352bd2f50bc8e793a71"
server_key_iv: "f63304878cc621103ca8175248cf6585"
server_key_version: "encryptionkey@0"
I20260809 22:49:46.080433 25805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:46.111231 25805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:46.116143 25805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:46.116477 25805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:46.140981 25805 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41517
I20260809 22:49:46.141002 25923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41517 every 8 connection(s)
I20260809 22:49:46.142510 25805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:49:46.146709 25924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:46.148672 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25805
I20260809 22:49:46.148937 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:49:46.149791 24077 external_mini_cluster.cc:1428] Setting key a6b9b0476d5ea97897057a96a453105b
I20260809 22:49:46.160436 25924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: Bootstrap starting.
I20260809 22:49:46.164626 25924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:46.165952 25924 log.cc:824] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:49:46 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:46.169044 25924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: No bootstrap required, opened a new log
I20260809 22:49:46.175889 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:46.152261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36902 (local address 127.23.131.126:41517)
0809 22:49:46.153479 (+ 1218us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:46.153495 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:46.153538 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:49:46.155524 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:46.155547 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:46.155914 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:46.156281 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:46.158082 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.159505 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.161227 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.161918 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.162093 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:46.167392 (+ 5299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:46.167402 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:46.167418 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:46.167467 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:46.171055 (+ 3588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:46.171957 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:46.171965 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:46.171971 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:46.172177 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:46.172661 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:46.172665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:46.172667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:46.173250 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:46.173655 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:46.174179 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 22:49:46.174676 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":908,"thread_start_us":649,"threads_started":1}
I20260809 22:49:46.177402 25924 raft_consensus.cc:348] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e90055b6ca50475b9f31a279601921da" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41517 } }
I20260809 22:49:46.177779 25924 raft_consensus.cc:374] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:46.177920 25924 raft_consensus.cc:729] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e90055b6ca50475b9f31a279601921da, State: Initialized, Role: FOLLOWER
I20260809 22:49:46.178580 25924 consensus_queue.cc:260] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e90055b6ca50475b9f31a279601921da" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41517 } }
I20260809 22:49:46.178858 25924 raft_consensus.cc:388] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:49:46.179037 25924 raft_consensus.cc:482] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:49:46.179271 25924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:46.181775 25924 raft_consensus.cc:504] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e90055b6ca50475b9f31a279601921da" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41517 } }
I20260809 22:49:46.182389 25924 leader_election.cc:302] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e90055b6ca50475b9f31a279601921da; no voters:
I20260809 22:49:46.183100 25924 leader_election.cc:288] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:49:46.183316 25932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:46.184243 25932 raft_consensus.cc:686] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [term 1 LEADER]: Becoming Leader. State: Replica: e90055b6ca50475b9f31a279601921da, State: Running, Role: LEADER
I20260809 22:49:46.184958 25932 consensus_queue.cc:237] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e90055b6ca50475b9f31a279601921da" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41517 } }
I20260809 22:49:46.185462 25924 sys_catalog.cc:564] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:49:46.188247 25935 sys_catalog.cc:455] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e90055b6ca50475b9f31a279601921da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e90055b6ca50475b9f31a279601921da" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41517 } } }
I20260809 22:49:46.188441 25936 sys_catalog.cc:455] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [sys.catalog]: SysCatalogTable state changed. Reason: New leader e90055b6ca50475b9f31a279601921da. Latest consensus state: current_term: 1 leader_uuid: "e90055b6ca50475b9f31a279601921da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e90055b6ca50475b9f31a279601921da" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41517 } } }
I20260809 22:49:46.188725 25935 sys_catalog.cc:458] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:46.188742 25936 sys_catalog.cc:458] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:46.200822 25944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:49:46.205482 25944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:49:46.214474 25944 catalog_manager.cc:1347] Generated new cluster ID: 4d1d522dae3e4cb299260e612b9cf428
I20260809 22:49:46.214644 25944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:49:46.253687 25944 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:49:46.255586 25944 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:49:46.261461 25944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: Generated new TSK 0
I20260809 22:49:46.262318 25944 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:49:46.327521 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41517
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:46.680245 25966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:46.680610 25966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:46.680790 25966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:46.688495 25966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:46.688658 25966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:46.688804 25966 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:49:46.688947 25966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:49:46.699160 25966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:41517
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:46.700594 25966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:46.702081 25966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:46.715735 25977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:46.715770 25973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:46.715698 25974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:46.716500 25966 server_base.cc:1034] running on GCE node
I20260809 22:49:46.717217 25966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:46.718192 25966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:46.719444 25966 hybrid_clock.cc:648] HybridClock initialized: now 1786315786719376 us; error 44 us; skew 500 ppm
I20260809 22:49:46.719767 25966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:46 dist-test-slave-92m1 krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315786, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:46.726665 25966 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:49:46.728206 25966 webserver.cc:460] Webserver started at http://127.23.131.65:46133/ using document root <none> and password file <none>
I20260809 22:49:46.728876 25966 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:46.728966 25966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:46.729246 25966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:46.732349 25966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "14837f61d9c54fbbb543f69b4c58023b"
format_stamp: "Formatted at 2026-08-09 22:49:46 on dist-test-slave-92m1"
server_key: "ea03d0c5f3be1431508417135778f7ad"
server_key_iv: "05eae5b2d7958fdf6cb7fd65138fe2a7"
server_key_version: "encryptionkey@0"
I20260809 22:49:46.733161 25966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "14837f61d9c54fbbb543f69b4c58023b"
format_stamp: "Formatted at 2026-08-09 22:49:46 on dist-test-slave-92m1"
server_key: "ea03d0c5f3be1431508417135778f7ad"
server_key_iv: "05eae5b2d7958fdf6cb7fd65138fe2a7"
server_key_version: "encryptionkey@0"
I20260809 22:49:46.738528 25966 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:49:46.742257 25987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:46.743775 25966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:49:46.743974 25966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "14837f61d9c54fbbb543f69b4c58023b"
format_stamp: "Formatted at 2026-08-09 22:49:46 on dist-test-slave-92m1"
server_key: "ea03d0c5f3be1431508417135778f7ad"
server_key_iv: "05eae5b2d7958fdf6cb7fd65138fe2a7"
server_key_version: "encryptionkey@0"
I20260809 22:49:46.744228 25966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:46.762760 25966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:46.768095 25966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:46.768407 25966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:46.771515 25966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:46.771639 25966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:46.771803 25966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:46.771885 25966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:49:46 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315786, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:46.797863 26003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:46.772325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:56009 (local address 127.23.131.126:41517)
0809 22:49:46.774803 (+ 2478us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:46.774810 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:46.774836 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:49:46.776529 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:46.776536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:46.776630 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:46.776764 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:46.779332 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.780461 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.783245 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.783898 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.784055 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:46.790416 (+ 6361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:46.790424 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:46.790431 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:46.790481 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:46.793821 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:46.795042 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:46.795046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:46.795049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:46.795180 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:46.795849 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:46.795853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:46.795855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:46.796135 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:46.796244 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:46.797407 (+ 1163us) server_negotiation.cc:299] Negotiation successful
0809 22:49:46.797592 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2332,"thread_start_us":2203,"threads_started":1}
I20260809 22:49:46.800225 26004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:46.773002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.23.131.65:56009)
0809 22:49:46.773920 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:46.773967 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:46.776216 (+ 2249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:46.777042 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:46.777051 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:46.777895 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:46.778992 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:46.779029 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.780661 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.780668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:46.783049 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:46.783063 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.784189 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.784202 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:46.784599 (+ 397us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:46.785543 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:46.785598 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:46.790088 (+ 4490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:46.793998 (+ 3910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:46.794012 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:46.794038 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:46.794892 (+ 854us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:46.795331 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:46.795339 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:46.795344 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:46.795710 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:46.796289 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:46.796302 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:46.796925 (+ 623us) client_negotiation.cc:769] Sending connection context
0809 22:49:46.797320 (+ 395us) client_negotiation.cc:240] Negotiation successful
0809 22:49:46.798096 (+ 776us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":395,"threads_started":1}
I20260809 22:49:46.824443 26003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:46.807480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53815 (local address 127.23.131.126:41517)
0809 22:49:46.807760 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:46.807769 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:46.808326 (+ 557us) server_negotiation.cc:407] Connection header received
0809 22:49:46.808547 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:46.808550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:46.808644 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:46.808730 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:46.810353 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.811101 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.814241 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.814811 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.814952 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:46.817963 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:46.817968 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:46.817971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:46.818008 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:46.821321 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:46.822311 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:46.822316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:46.822320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:46.822465 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:46.822855 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:46.822860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:46.822864 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:46.823176 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:46.823387 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:46.823792 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 22:49:46.824045 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 22:49:46.824545 26111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:46.807399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.23.131.65:53815)
0809 22:49:46.808190 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:46.808217 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:46.808413 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:46.808807 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:46.808814 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:46.809635 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:46.810156 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:46.810174 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.811269 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.811278 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:46.814038 (+ 2760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:46.814061 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:46.815240 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:46.815252 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:46.815524 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:46.816317 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:46.816348 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:46.817686 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:46.821495 (+ 3809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:46.821498 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:46.821501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:46.822167 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:46.822586 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:46.822592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:46.822605 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:46.822730 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:46.823327 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:46.823332 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:46.823527 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 22:49:46.823675 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 22:49:46.824045 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":383,"threads_started":1}
I20260809 22:49:46.833148 25966 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:39925
I20260809 22:49:46.833171 26180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:39925 every 8 connection(s)
I20260809 22:49:46.834519 25966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:49:46.836733 26181 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41517
I20260809 22:49:46.836989 26181 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:46.837716 26181 heartbeater.cc:511] Master 127.23.131.126:41517 requested a full tablet report, sending...
I20260809 22:49:46.839843 25850 ts_manager.cc:194] Registered new tserver with Master: 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925)
I20260809 22:49:46.841331 25850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:56009
I20260809 22:49:46.844332 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25966
I20260809 22:49:46.844573 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:49:46.845234 24077 external_mini_cluster.cc:1428] Setting key c029faefd9943e1b7aae3d397d52dd87
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:49:46.897996 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41517
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:47.253494 26187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:47.253849 26187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:47.254037 26187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:47.261197 26187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:47.261349 26187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:47.261523 26187 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:49:47.261657 26187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:49:47.271627 26187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:41517
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:47.272840 26187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:47.274111 26187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:47.287923 26201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:47.287966 26197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:47.288005 26198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:47.289229 26187 server_base.cc:1034] running on GCE node
I20260809 22:49:47.289903 26187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:47.291038 26187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:47.294435 26187 hybrid_clock.cc:648] HybridClock initialized: now 1786315787294353 us; error 68 us; skew 500 ppm
I20260809 22:49:47.294796 26187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:47 dist-test-slave-92m1 krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315787, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:47.298359 26187 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:49:47.300119 26187 webserver.cc:460] Webserver started at http://127.23.131.66:34781/ using document root <none> and password file <none>
I20260809 22:49:47.300900 26187 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:47.301043 26187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:47.301602 26187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:47.305554 26187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "9d980912622e4871b91821f88872a9df"
format_stamp: "Formatted at 2026-08-09 22:49:47 on dist-test-slave-92m1"
server_key: "0e7cacc26198b9cdd4bd4edea3845892"
server_key_iv: "24441d2c08f8f226c62ae10ee6ad35ed"
server_key_version: "encryptionkey@0"
I20260809 22:49:47.307190 26187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "9d980912622e4871b91821f88872a9df"
format_stamp: "Formatted at 2026-08-09 22:49:47 on dist-test-slave-92m1"
server_key: "0e7cacc26198b9cdd4bd4edea3845892"
server_key_iv: "24441d2c08f8f226c62ae10ee6ad35ed"
server_key_version: "encryptionkey@0"
I20260809 22:49:47.314376 26187 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 22:49:47.318593 26215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:47.320135 26187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:49:47.320359 26187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "9d980912622e4871b91821f88872a9df"
format_stamp: "Formatted at 2026-08-09 22:49:47 on dist-test-slave-92m1"
server_key: "0e7cacc26198b9cdd4bd4edea3845892"
server_key_iv: "24441d2c08f8f226c62ae10ee6ad35ed"
server_key_version: "encryptionkey@0"
I20260809 22:49:47.320641 26187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:47.358790 26187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:47.364162 26187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:47.364514 26187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:47.367743 26187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:47.367882 26187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:47.368062 26187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:47.368155 26187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:49:47 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315787, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:47.394130 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.368400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:44857 (local address 127.23.131.126:41517)
0809 22:49:47.368923 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:47.368932 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:47.370329 (+ 1397us) server_negotiation.cc:407] Connection header received
0809 22:49:47.372808 (+ 2479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:47.372815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:47.372912 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:47.373033 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:47.375024 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.376543 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.379407 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.380084 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.380239 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.385217 (+ 4978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:47.385228 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:47.385236 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:47.385293 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:47.389024 (+ 3731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.390333 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.390342 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.390347 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.390540 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.391306 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.391313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.391319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.391884 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:47.392121 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:47.393057 (+ 936us) server_negotiation.cc:299] Negotiation successful
0809 22:49:47.393469 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":287,"threads_started":1}
I20260809 22:49:47.394582 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.369244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.23.131.66:44857)
0809 22:49:47.370149 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:47.370194 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:47.372499 (+ 2305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:47.373276 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:47.373284 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:47.373843 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:47.374779 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.374812 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.376753 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.376764 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.379179 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.379195 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.380380 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.380392 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.380646 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.381560 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:47.381588 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:47.384809 (+ 3221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:47.389227 (+ 4418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.389248 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.389269 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.390120 (+ 851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.390709 (+ 589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.390712 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.390714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.391061 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.392057 (+ 996us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:47.392066 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:47.392527 (+ 461us) client_negotiation.cc:769] Sending connection context
0809 22:49:47.392801 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 22:49:47.393349 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":382,"threads_started":1}
I20260809 22:49:47.421963 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.401551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:56809 (local address 127.23.131.126:41517)
0809 22:49:47.401772 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:47.401780 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:47.402809 (+ 1029us) server_negotiation.cc:407] Connection header received
0809 22:49:47.403085 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:47.403091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:47.403241 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:47.403346 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:47.404959 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.406060 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.409185 (+ 3125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.410071 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.410244 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.414522 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:47.414527 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:47.414531 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:47.414570 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:47.418128 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.419180 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.419186 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.419190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.419379 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.419980 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.419990 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.419996 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.420620 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:47.420847 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:47.421340 (+ 493us) server_negotiation.cc:299] Negotiation successful
0809 22:49:47.421608 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:49:47.422166 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.401651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.23.131.66:56809)
0809 22:49:47.402658 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:47.402681 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:47.402928 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:47.403379 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:47.403387 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:47.404170 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:47.404711 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.404733 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.406239 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.406247 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.408895 (+ 2648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.408920 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.410637 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.410648 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.410937 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.412500 (+ 1563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:47.412538 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:47.414272 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:47.418295 (+ 4023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.418301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.418305 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.419030 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.419517 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.419522 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.419526 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.419815 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.420820 (+ 1005us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:47.420827 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:47.421055 (+ 228us) client_negotiation.cc:769] Sending connection context
0809 22:49:47.421228 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 22:49:47.421648 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"thread_start_us":694,"threads_started":1}
I20260809 22:49:47.424371 26400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:40147 every 8 connection(s)
I20260809 22:49:47.424412 26187 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:40147
I20260809 22:49:47.426244 26187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:49:47.428757 26402 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41517
I20260809 22:49:47.428988 26402 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:47.429656 26402 heartbeater.cc:511] Master 127.23.131.126:41517 requested a full tablet report, sending...
I20260809 22:49:47.431092 25850 ts_manager.cc:194] Registered new tserver with Master: 9d980912622e4871b91821f88872a9df (127.23.131.66:40147)
I20260809 22:49:47.431973 25850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:44857
I20260809 22:49:47.433497 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26187
I20260809 22:49:47.433743 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:49:47.434191 24077 external_mini_cluster.cc:1428] Setting key 245686e84bb293e7fe9764f489ae72b8
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:49:47.486394 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41517
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:49:47.844167 26181 heartbeater.cc:503] Master 127.23.131.126:41517 was elected leader, sending a full tablet report...
W20260809 22:49:47.845695 26406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:47.846107 26406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:47.846297 26406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:47.854413 26406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:47.854518 26406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:47.854609 26406 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:49:47.854700 26406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:49:47.864976 26406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:41517
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:47.866276 26406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:47.867713 26406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:47.881377 26413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:47.881404 26416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:47.881433 26414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:47.882239 26406 server_base.cc:1034] running on GCE node
I20260809 22:49:47.882876 26406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:47.883945 26406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:47.885228 26406 hybrid_clock.cc:648] HybridClock initialized: now 1786315787885092 us; error 61 us; skew 500 ppm
I20260809 22:49:47.885573 26406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:47 dist-test-slave-92m1 krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315787, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:47.888988 26406 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:49:47.890633 26406 webserver.cc:460] Webserver started at http://127.23.131.67:44201/ using document root <none> and password file <none>
I20260809 22:49:47.891464 26406 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:47.891604 26406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:47.891949 26406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:47.895722 26406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "03c17b14cf2144c794b58cb281e10ef8"
format_stamp: "Formatted at 2026-08-09 22:49:47 on dist-test-slave-92m1"
server_key: "4b58d01922b46a9bef0faed3da084c32"
server_key_iv: "c0da5f2a0f5985e2f301af4699366896"
server_key_version: "encryptionkey@0"
I20260809 22:49:47.896646 26406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "03c17b14cf2144c794b58cb281e10ef8"
format_stamp: "Formatted at 2026-08-09 22:49:47 on dist-test-slave-92m1"
server_key: "4b58d01922b46a9bef0faed3da084c32"
server_key_iv: "c0da5f2a0f5985e2f301af4699366896"
server_key_version: "encryptionkey@0"
I20260809 22:49:47.902174 26406 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:49:47.905807 26425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:47.907127 26406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:49:47.907368 26406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "03c17b14cf2144c794b58cb281e10ef8"
format_stamp: "Formatted at 2026-08-09 22:49:47 on dist-test-slave-92m1"
server_key: "4b58d01922b46a9bef0faed3da084c32"
server_key_iv: "c0da5f2a0f5985e2f301af4699366896"
server_key_version: "encryptionkey@0"
I20260809 22:49:47.907603 26406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:47.931416 26406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:47.935787 26406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:47.936110 26406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:47.939114 26406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:47.939257 26406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 22:49:47.939462 26406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:47.939584 26406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:49:47 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315787, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:47.965540 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.939919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:33099 (local address 127.23.131.126:41517)
0809 22:49:47.940614 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:47.940618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:47.941657 (+ 1039us) server_negotiation.cc:407] Connection header received
0809 22:49:47.943873 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:47.943879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:47.943978 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:47.944099 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:47.946508 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.947745 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.950664 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.951377 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.951572 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.956912 (+ 5340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:47.956921 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:47.956928 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:47.956980 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:47.960537 (+ 3557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.961722 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.961727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.961731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.961932 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.962670 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.962674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.962676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.963117 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:47.963298 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:47.964560 (+ 1262us) server_negotiation.cc:299] Negotiation successful
0809 22:49:47.964917 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":447,"threads_started":1}
I20260809 22:49:47.966174 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.940631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.23.131.67:33099)
0809 22:49:47.941483 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:47.941523 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:47.943564 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:47.944368 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:47.944377 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:47.945213 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:47.946208 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.946248 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.947937 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.947942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.950426 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.950439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.951687 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.951697 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.951990 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.952961 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:47.952995 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:47.956579 (+ 3584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:47.960694 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.960703 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.960716 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.961470 (+ 754us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.962078 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.962082 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.962084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.962488 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.963301 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:47.963311 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:47.964024 (+ 713us) client_negotiation.cc:769] Sending connection context
0809 22:49:47.964404 (+ 380us) client_negotiation.cc:240] Negotiation successful
0809 22:49:47.964919 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":385,"threads_started":1}
I20260809 22:49:47.995719 26406 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:40117
I20260809 22:49:47.995741 26612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:40117 every 8 connection(s)
I20260809 22:49:47.997372 26406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:49:47.999697 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.973274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:37871 (local address 127.23.131.126:41517)
0809 22:49:47.973559 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:47.973569 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:47.977330 (+ 3761us) server_negotiation.cc:407] Connection header received
0809 22:49:47.977491 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:47.977499 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:47.977607 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:47.977732 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:47.979515 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.980898 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.983795 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.984228 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.984376 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.988085 (+ 3709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:47.988093 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:47.988101 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:47.988152 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:47.995570 (+ 7418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.996711 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.996716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.996721 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.996920 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:47.997569 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:47.997575 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:47.997579 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:47.997984 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:47.998232 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:47.998873 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 22:49:47.999195 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:49:47.999881 26544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:47.972756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.23.131.67:37871)
0809 22:49:47.977178 (+ 4422us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:47.977202 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:47.977361 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:47.977804 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:47.977811 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:47.978689 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:47.979285 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.979308 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.981203 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.981213 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.983601 (+ 2388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:47.983620 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:47.984475 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:47.984483 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:47.984677 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:47.985895 (+ 1218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:47.985941 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:47.987776 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:47.995768 (+ 7992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.995775 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.995780 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.996455 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.997064 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:47.997069 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:47.997072 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:47.997346 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:47.998201 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:47.998208 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:47.998501 (+ 293us) client_negotiation.cc:769] Sending connection context
0809 22:49:47.998686 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 22:49:47.999170 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4265,"thread_start_us":4118,"threads_started":1}
I20260809 22:49:48.000592 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26406
I20260809 22:49:48.000829 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:49:48.001470 24077 external_mini_cluster.cc:1428] Setting key 6172fa33089e40b1c52584f9f0226618
I20260809 22:49:48.003007 26615 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41517
I20260809 22:49:48.006117 26615 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:48.007002 26615 heartbeater.cc:511] Master 127.23.131.126:41517 requested a full tablet report, sending...
I20260809 22:49:48.008474 25849 ts_manager.cc:194] Registered new tserver with Master: 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.009377 25849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:33099
I20260809 22:49:48.017582 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 22:49:48 dist-test-slave-92m1 krb5kdc[25789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 22:49:48 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:48.072963 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.058698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.23.131.126:41517)
0809 22:49:48.058939 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.058946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.059135 (+ 189us) server_negotiation.cc:407] Connection header received
0809 22:49:48.059440 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.059445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.059514 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.059637 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:48.061025 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.061771 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.063072 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.063583 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.063733 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.067812 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:48.067817 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:48.067821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:48.067853 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:48.070596 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:48.071173 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:48.071177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:48.071179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:48.071364 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:48.071693 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:48.071696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:48.071698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:48.071949 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:48.072154 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.072385 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.072553 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 22:49:48.077121 25849 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:48.084086 25849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:48.107375 26638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.096717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60996 (local address 127.23.131.66:40147)
0809 22:49:48.097324 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.097336 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.098810 (+ 1474us) server_negotiation.cc:407] Connection header received
0809 22:49:48.098934 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.098942 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.099167 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.099404 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:48.100218 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.101698 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.104159 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.105428 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.105548 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.105759 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.106914 (+ 1155us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.107062 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":975,"threads_started":1}
I20260809 22:49:48.107738 26636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.095804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55238 (local address 127.23.131.65:39925)
0809 22:49:48.096526 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.096539 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.097457 (+ 918us) server_negotiation.cc:407] Connection header received
0809 22:49:48.097571 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.097581 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.097843 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.098045 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:48.099089 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.100720 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.103724 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.105215 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.105353 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.105613 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.107249 (+ 1636us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.107425 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":310,"threads_started":1}
I20260809 22:49:48.108011 26637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.095543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39925 (local address 127.0.0.1:55238)
0809 22:49:48.097020 (+ 1477us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.097058 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.097244 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.098332 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.098341 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.098394 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:48.098902 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.098916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.100878 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.100884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.103524 (+ 2640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.103542 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.105766 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.105774 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.106963 (+ 1189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.107027 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 22:49:48.107156 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 22:49:48.107365 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1201,"mutex_wait_us":800,"thread_start_us":2640,"threads_started":1}
I20260809 22:49:48.108467 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.096175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:40147 (local address 127.0.0.1:60996)
0809 22:49:48.098527 (+ 2352us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.098548 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.098672 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.099599 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.099603 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.099629 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:48.100011 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.100022 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.101863 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.101868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.103973 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.103986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.105902 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.105907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.106167 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.106243 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 22:49:48.106376 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 22:49:48.106561 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2171,"mutex_wait_us":1,"thread_start_us":686,"threads_started":1}
I20260809 22:49:48.112102 26066 tablet_service.cc:1467] Processing CreateTablet for tablet 4c53089d712647f1aef9e683b1ecbb44 (DEFAULT_TABLE table=test-table [id=c24bfb90b576406491c61fbf6e338835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:48.112895 26298 tablet_service.cc:1467] Processing CreateTablet for tablet 4c53089d712647f1aef9e683b1ecbb44 (DEFAULT_TABLE table=test-table [id=c24bfb90b576406491c61fbf6e338835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:48.113572 26066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c53089d712647f1aef9e683b1ecbb44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.114277 26298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c53089d712647f1aef9e683b1ecbb44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.118112 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.098638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:40117 (local address 127.0.0.1:48756)
0809 22:49:48.108338 (+ 9700us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.108358 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.108490 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.109687 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.109701 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.109724 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:48.110090 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.110098 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.112413 (+ 2315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.112419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.115242 (+ 2823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.115259 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.117298 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.117306 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.117501 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.117541 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:49:48.117643 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:49:48.117772 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9572,"thread_start_us":9413,"threads_started":1}
I20260809 22:49:48.118256 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.098935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.23.131.67:40117)
0809 22:49:48.106544 (+ 7609us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.106551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.108716 (+ 2165us) server_negotiation.cc:407] Connection header received
0809 22:49:48.108849 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.108859 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.109112 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.109323 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:48.110318 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.112211 (+ 1893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.115471 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.117070 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.117230 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.117500 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.117709 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.117888 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7437,"thread_start_us":7249,"threads_started":1}
I20260809 22:49:48.122987 26506 tablet_service.cc:1467] Processing CreateTablet for tablet 4c53089d712647f1aef9e683b1ecbb44 (DEFAULT_TABLE table=test-table [id=c24bfb90b576406491c61fbf6e338835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:48.124569 26506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c53089d712647f1aef9e683b1ecbb44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.129092 26641 tablet_bootstrap.cc:492] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Bootstrap starting.
I20260809 22:49:48.130352 26645 tablet_bootstrap.cc:492] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Bootstrap starting.
I20260809 22:49:48.133379 26641 tablet_bootstrap.cc:654] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.134268 26645 tablet_bootstrap.cc:654] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.134904 26641 log.cc:824] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:48.135739 26645 log.cc:824] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:48.138271 26641 tablet_bootstrap.cc:492] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: No bootstrap required, opened a new log
I20260809 22:49:48.138628 26641 ts_tablet_manager.cc:1397] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260809 22:49:48.139045 26645 tablet_bootstrap.cc:492] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: No bootstrap required, opened a new log
I20260809 22:49:48.139380 26645 ts_tablet_manager.cc:1397] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260809 22:49:48.140187 26648 tablet_bootstrap.cc:492] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Bootstrap starting.
I20260809 22:49:48.144201 26648 tablet_bootstrap.cc:654] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.145620 26648 log.cc:824] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:48.150130 26641 raft_consensus.cc:348] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.150688 26641 raft_consensus.cc:374] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.150822 26641 raft_consensus.cc:729] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d980912622e4871b91821f88872a9df, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.151599 26641 consensus_queue.cc:260] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.155251 26645 raft_consensus.cc:348] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.155929 26645 raft_consensus.cc:374] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.156066 26645 raft_consensus.cc:729] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14837f61d9c54fbbb543f69b4c58023b, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.156850 26645 consensus_queue.cc:260] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.159821 26645 ts_tablet_manager.cc:1428] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Time spent starting tablet: real 0.020s user 0.009s sys 0.008s
I20260809 22:49:48.159991 26641 ts_tablet_manager.cc:1428] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Time spent starting tablet: real 0.021s user 0.020s sys 0.000s
I20260809 22:49:48.159864 26402 heartbeater.cc:503] Master 127.23.131.126:41517 was elected leader, sending a full tablet report...
I20260809 22:49:48.162179 26648 tablet_bootstrap.cc:492] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: No bootstrap required, opened a new log
I20260809 22:49:48.162457 26648 ts_tablet_manager.cc:1397] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.012s
I20260809 22:49:48.171334 26648 raft_consensus.cc:348] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.171698 26648 raft_consensus.cc:374] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.171779 26648 raft_consensus.cc:729] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c17b14cf2144c794b58cb281e10ef8, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.172372 26648 consensus_queue.cc:260] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.173431 26615 heartbeater.cc:503] Master 127.23.131.126:41517 was elected leader, sending a full tablet report...
I20260809 22:49:48.174139 26648 ts_tablet_manager.cc:1428] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
W20260809 22:49:48.178553 26403 tablet.cc:2369] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:49:48.252301 26616 tablet.cc:2369] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:49:48.337303 26182 tablet.cc:2369] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:49:48.358341 26651 raft_consensus.cc:482] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:48.358723 26651 raft_consensus.cc:504] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.360564 26651 leader_election.cc:288] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925), 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.367556 26636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.360974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:50795 (local address 127.23.131.65:39925)
0809 22:49:48.361187 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.361192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.361722 (+ 530us) server_negotiation.cc:407] Connection header received
0809 22:49:48.361975 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.361983 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.362088 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.362228 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:48.363013 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.363828 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.365739 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.366556 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.366745 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.366829 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.367145 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.367301 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 22:49:48.367739 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.360867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39925 (local address 127.23.131.66:50795)
0809 22:49:48.361581 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.361623 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.361776 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.362259 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.362264 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.362295 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:48.362817 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.362832 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.363970 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.363975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.365564 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.365577 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.366794 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.366800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.366965 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.366996 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 22:49:48.367117 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 22:49:48.367274 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":7,"spinlock_wait_cycles":24960,"thread_start_us":375,"threads_started":1}
I20260809 22:49:48.367731 26640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.361889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:35721 (local address 127.23.131.67:40117)
0809 22:49:48.362093 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.362098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.362495 (+ 397us) server_negotiation.cc:407] Connection header received
0809 22:49:48.362622 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.362627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.362713 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.362816 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:48.363433 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.364149 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.365932 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.366721 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.366914 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.366992 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.367338 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.367469 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:49:48.367870 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.361696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:40117 (local address 127.23.131.66:35721)
0809 22:49:48.362383 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.362397 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.362512 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.362839 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.362842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.362860 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:48.363190 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.363245 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.364307 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.364312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.365764 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.365777 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.366957 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.366964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.367145 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.367168 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 22:49:48.367303 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 22:49:48.367437 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":28,"thread_start_us":385,"threads_started":1}
I20260809 22:49:48.368952 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c53089d712647f1aef9e683b1ecbb44" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14837f61d9c54fbbb543f69b4c58023b" is_pre_election: true
I20260809 22:49:48.368952 26546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c53089d712647f1aef9e683b1ecbb44" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17b14cf2144c794b58cb281e10ef8" is_pre_election: true
I20260809 22:49:48.369592 26110 raft_consensus.cc:2454] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 0.
I20260809 22:49:48.369602 26546 raft_consensus.cc:2454] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 0.
I20260809 22:49:48.370270 26219 leader_election.cc:302] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c17b14cf2144c794b58cb281e10ef8, 9d980912622e4871b91821f88872a9df; no voters:
I20260809 22:49:48.370724 26651 raft_consensus.cc:2781] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:48.370893 26651 raft_consensus.cc:482] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:48.371027 26651 raft_consensus.cc:3037] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.373629 26651 raft_consensus.cc:504] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.374269 26651 leader_election.cc:288] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 election: Requested vote from peers 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925), 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.374805 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c53089d712647f1aef9e683b1ecbb44" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14837f61d9c54fbbb543f69b4c58023b"
I20260809 22:49:48.374959 26546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c53089d712647f1aef9e683b1ecbb44" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17b14cf2144c794b58cb281e10ef8"
I20260809 22:49:48.375020 26110 raft_consensus.cc:3037] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.375208 26546 raft_consensus.cc:3037] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.377439 26110 raft_consensus.cc:2454] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 1.
I20260809 22:49:48.377722 26546 raft_consensus.cc:2454] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 1.
I20260809 22:49:48.377923 26219 leader_election.cc:302] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14837f61d9c54fbbb543f69b4c58023b, 9d980912622e4871b91821f88872a9df; no voters:
I20260809 22:49:48.378261 26651 raft_consensus.cc:2781] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:48.378744 26651 raft_consensus.cc:686] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 1 LEADER]: Becoming Leader. State: Replica: 9d980912622e4871b91821f88872a9df, State: Running, Role: LEADER
I20260809 22:49:48.379345 26651 consensus_queue.cc:237] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } }
I20260809 22:49:48.384145 25848 catalog_manager.cc:5495] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d980912622e4871b91821f88872a9df (127.23.131.66). New cstate: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } health_report { overall_health: HEALTHY } } }
I20260809 22:49:48.411744 26638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.406370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32772 (local address 127.23.131.66:40147)
0809 22:49:48.406561 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.406565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.406677 (+ 112us) server_negotiation.cc:407] Connection header received
0809 22:49:48.406940 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.406944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.407034 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.407160 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:48.407567 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.408303 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.409622 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.410029 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.410125 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.410603 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:48.411153 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:48.411343 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.411434 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.411507 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:49:48.420218 26546 raft_consensus.cc:1261] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Refusing update from remote peer 9d980912622e4871b91821f88872a9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:48.420269 26110 raft_consensus.cc:1261] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Refusing update from remote peer 9d980912622e4871b91821f88872a9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:48.421203 26659 consensus_queue.cc:1035] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:48.421581 26651 consensus_queue.cc:1035] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:48.450369 26665 mvcc.cc:205] Tried to move back new op lower bound from 7316749469359681536 to 7316749469205762048. Current Snapshot: MvccSnapshot[applied={T|T < 7316749469359681536}]
I20260809 22:49:48.463665 25850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:48.463963 25850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:48.467670 25850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: Sending DeleteTablet for 3 replicas of tablet 4c53089d712647f1aef9e683b1ecbb44
I20260809 22:49:48.468967 26066 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c53089d712647f1aef9e683b1ecbb44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:48 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55238
I20260809 22:49:48.469043 26506 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c53089d712647f1aef9e683b1ecbb44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:48 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:48756
I20260809 22:49:48.469159 26298 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c53089d712647f1aef9e683b1ecbb44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:48 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:60996
I20260809 22:49:48.471748 25850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:48.473266 25850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:48.492244 26502 tablet_service.cc:1467] Processing CreateTablet for tablet ff1f1e689ef547d5a127aad101fb8869 (DEFAULT_TABLE table=test-table [id=f83d651244fc4b2a9287b13bc6a0b40e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:48.492355 26064 tablet_service.cc:1467] Processing CreateTablet for tablet ff1f1e689ef547d5a127aad101fb8869 (DEFAULT_TABLE table=test-table [id=f83d651244fc4b2a9287b13bc6a0b40e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:48.492847 26502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff1f1e689ef547d5a127aad101fb8869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.492985 26064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff1f1e689ef547d5a127aad101fb8869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.498179 26297 tablet_service.cc:1467] Processing CreateTablet for tablet ff1f1e689ef547d5a127aad101fb8869 (DEFAULT_TABLE table=test-table [id=f83d651244fc4b2a9287b13bc6a0b40e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:48.498844 26297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff1f1e689ef547d5a127aad101fb8869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.502251 26648 tablet_bootstrap.cc:492] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Bootstrap starting.
I20260809 22:49:48.504199 26648 tablet_bootstrap.cc:654] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.533399 26645 tablet_bootstrap.cc:492] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Bootstrap starting.
I20260809 22:49:48.534675 26641 tablet_bootstrap.cc:492] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Bootstrap starting.
I20260809 22:49:48.535637 26645 tablet_bootstrap.cc:654] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.536664 26641 tablet_bootstrap.cc:654] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.547470 26641 tablet_bootstrap.cc:492] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: No bootstrap required, opened a new log
I20260809 22:49:48.547788 26641 ts_tablet_manager.cc:1397] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.001s
I20260809 22:49:48.548425 26648 tablet_bootstrap.cc:492] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: No bootstrap required, opened a new log
I20260809 22:49:48.548915 26648 ts_tablet_manager.cc:1397] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.019s
I20260809 22:49:48.549153 26641 raft_consensus.cc:348] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.549504 26641 raft_consensus.cc:374] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.549783 26641 raft_consensus.cc:729] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d980912622e4871b91821f88872a9df, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.550267 26641 consensus_queue.cc:260] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.551527 26641 ts_tablet_manager.cc:1428] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260809 22:49:48.550506 26680 tablet_replica.cc:330] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: stopping tablet replica
I20260809 22:49:48.551755 26677 tablet_replica.cc:330] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: stopping tablet replica
I20260809 22:49:48.551934 26679 tablet_replica.cc:330] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: stopping tablet replica
I20260809 22:49:48.552280 26677 raft_consensus.cc:2229] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:48.552413 26679 raft_consensus.cc:2229] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:48.552891 26679 raft_consensus.cc:2258] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:48.551024 26648 raft_consensus.cc:348] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.553318 26648 raft_consensus.cc:374] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.553437 26648 raft_consensus.cc:729] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c17b14cf2144c794b58cb281e10ef8, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.553702 26648 consensus_queue.cc:260] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.552289 26680 raft_consensus.cc:2229] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:49:48.554486 26648 ts_tablet_manager.cc:1428] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 22:49:48.554808 26680 raft_consensus.cc:2258] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:48.554949 26677 raft_consensus.cc:2258] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:48.557521 26645 tablet_bootstrap.cc:492] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: No bootstrap required, opened a new log
I20260809 22:49:48.557722 26645 ts_tablet_manager.cc:1397] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.005s
I20260809 22:49:48.557873 26677 ts_tablet_manager.cc:1905] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:48.558655 26645 raft_consensus.cc:348] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.558915 26645 raft_consensus.cc:374] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.559038 26645 raft_consensus.cc:729] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14837f61d9c54fbbb543f69b4c58023b, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.559363 26645 consensus_queue.cc:260] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.560019 26679 ts_tablet_manager.cc:1905] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:48.560521 26645 ts_tablet_manager.cc:1428] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 22:49:48.562923 26680 ts_tablet_manager.cc:1905] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:48.567562 26679 ts_tablet_manager.cc:1918] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:49:48.567829 26679 log.cc:1196] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/4c53089d712647f1aef9e683b1ecbb44
I20260809 22:49:48.568387 26679 ts_tablet_manager.cc:1939] T 4c53089d712647f1aef9e683b1ecbb44 P 03c17b14cf2144c794b58cb281e10ef8: Deleting consensus metadata
I20260809 22:49:48.570451 25834 catalog_manager.cc:4841] TS 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117): tablet 4c53089d712647f1aef9e683b1ecbb44 (table test-table [id=c24bfb90b576406491c61fbf6e338835]) successfully deleted
I20260809 22:49:48.571821 26680 ts_tablet_manager.cc:1918] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:49:48.572036 26680 log.cc:1196] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/4c53089d712647f1aef9e683b1ecbb44
I20260809 22:49:48.572692 26680 ts_tablet_manager.cc:1939] T 4c53089d712647f1aef9e683b1ecbb44 P 9d980912622e4871b91821f88872a9df: Deleting consensus metadata
I20260809 22:49:48.574187 26677 ts_tablet_manager.cc:1918] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:49:48.574540 26677 log.cc:1196] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/4c53089d712647f1aef9e683b1ecbb44
I20260809 22:49:48.574537 25835 catalog_manager.cc:4841] TS 9d980912622e4871b91821f88872a9df (127.23.131.66:40147): tablet 4c53089d712647f1aef9e683b1ecbb44 (table test-table [id=c24bfb90b576406491c61fbf6e338835]) successfully deleted
I20260809 22:49:48.575060 26677 ts_tablet_manager.cc:1939] T 4c53089d712647f1aef9e683b1ecbb44 P 14837f61d9c54fbbb543f69b4c58023b: Deleting consensus metadata
I20260809 22:49:48.576598 25834 catalog_manager.cc:4841] TS 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925): tablet 4c53089d712647f1aef9e683b1ecbb44 (table test-table [id=c24bfb90b576406491c61fbf6e338835]) successfully deleted
I20260809 22:49:48.688721 26651 raft_consensus.cc:482] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:48.688966 26651 raft_consensus.cc:504] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.689774 26651 leader_election.cc:288] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925), 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.690657 26546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff1f1e689ef547d5a127aad101fb8869" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17b14cf2144c794b58cb281e10ef8" is_pre_election: true
I20260809 22:49:48.690927 26546 raft_consensus.cc:2454] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 0.
I20260809 22:49:48.691469 26219 leader_election.cc:302] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c17b14cf2144c794b58cb281e10ef8, 9d980912622e4871b91821f88872a9df; no voters:
I20260809 22:49:48.691571 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff1f1e689ef547d5a127aad101fb8869" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14837f61d9c54fbbb543f69b4c58023b" is_pre_election: true
I20260809 22:49:48.691783 26651 raft_consensus.cc:2781] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:48.691891 26110 raft_consensus.cc:2454] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 0.
I20260809 22:49:48.691946 26651 raft_consensus.cc:482] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:48.692039 26651 raft_consensus.cc:3037] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.695353 26651 raft_consensus.cc:504] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.696007 26651 leader_election.cc:288] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 election: Requested vote from peers 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925), 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.696512 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff1f1e689ef547d5a127aad101fb8869" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14837f61d9c54fbbb543f69b4c58023b"
I20260809 22:49:48.696614 26546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff1f1e689ef547d5a127aad101fb8869" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17b14cf2144c794b58cb281e10ef8"
I20260809 22:49:48.696777 26110 raft_consensus.cc:3037] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.696832 26546 raft_consensus.cc:3037] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.699963 26546 raft_consensus.cc:2454] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 1.
I20260809 22:49:48.699963 26110 raft_consensus.cc:2454] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 1.
I20260809 22:49:48.700434 26219 leader_election.cc:302] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14837f61d9c54fbbb543f69b4c58023b, 9d980912622e4871b91821f88872a9df; no voters:
I20260809 22:49:48.700783 26651 raft_consensus.cc:2781] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:48.700995 26651 raft_consensus.cc:686] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 1 LEADER]: Becoming Leader. State: Replica: 9d980912622e4871b91821f88872a9df, State: Running, Role: LEADER
I20260809 22:49:48.701409 26651 consensus_queue.cc:237] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.704735 25850 catalog_manager.cc:5495] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d980912622e4871b91821f88872a9df (127.23.131.66). New cstate: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } health_report { overall_health: UNKNOWN } } }
Aug 09 22:49:48 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315786, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:48.773135 26694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.758237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36914 (local address 127.23.131.126:41517)
0809 22:49:48.759260 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.759265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.759287 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:49:48.759338 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.759342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.759397 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.759510 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:48.760631 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.761384 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.762681 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.763090 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.763255 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.767032 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:48.767036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:48.767040 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:48.767071 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:48.770067 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:48.771034 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:48.771038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:48.771040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:48.771160 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:48.771692 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:48.771695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:48.771697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:48.771975 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:48.772082 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:48.772670 (+ 588us) server_negotiation.cc:299] Negotiation successful
0809 22:49:48.772853 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":692,"threads_started":1}
I20260809 22:49:48.773571 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.758170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41517 (local address 127.0.0.1:36914)
0809 22:49:48.758903 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.758928 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.759128 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.759536 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.759540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.760237 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:48.760445 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.760455 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.761535 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.761542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.762526 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.762538 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:48.763287 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:48.763292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:48.763461 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:48.764148 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:48.764166 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:48.766779 (+ 2613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:48.770220 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:48.770234 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:48.770243 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:48.770912 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:48.771333 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:48.771338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:48.771343 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:48.771543 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:48.772138 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:48.772147 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:48.772356 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 22:49:48.772578 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 22:49:48.773063 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":106,"thread_start_us":377,"threads_started":1}
I20260809 22:49:48.779794 25850 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:36914:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 22:49:48.780900 25850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:48.788288 26066 tablet_service.cc:1467] Processing CreateTablet for tablet 7c4554ac9c454a739a8835d50f7b1780 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=792cee54156c497581c19658172e512f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:49:48.788535 26298 tablet_service.cc:1467] Processing CreateTablet for tablet 7c4554ac9c454a739a8835d50f7b1780 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=792cee54156c497581c19658172e512f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:49:48.789004 26066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c4554ac9c454a739a8835d50f7b1780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.789166 26298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c4554ac9c454a739a8835d50f7b1780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.795372 26641 tablet_bootstrap.cc:492] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: Bootstrap starting.
I20260809 22:49:48.795449 26645 tablet_bootstrap.cc:492] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: Bootstrap starting.
I20260809 22:49:48.795971 26506 tablet_service.cc:1467] Processing CreateTablet for tablet 7c4554ac9c454a739a8835d50f7b1780 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=792cee54156c497581c19658172e512f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:49:48.796612 26506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c4554ac9c454a739a8835d50f7b1780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:48.797320 26641 tablet_bootstrap.cc:654] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.797330 26645 tablet_bootstrap.cc:654] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.805315 26645 tablet_bootstrap.cc:492] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: No bootstrap required, opened a new log
I20260809 22:49:48.805615 26645 ts_tablet_manager.cc:1397] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260809 22:49:48.806363 26648 tablet_bootstrap.cc:492] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: Bootstrap starting.
I20260809 22:49:48.806658 26645 raft_consensus.cc:348] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.806923 26645 raft_consensus.cc:374] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.807010 26645 raft_consensus.cc:729] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14837f61d9c54fbbb543f69b4c58023b, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.807369 26645 consensus_queue.cc:260] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.808297 26648 tablet_bootstrap.cc:654] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:48.808044 26652 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:48.808462 26652 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:48.808813 26641 tablet_bootstrap.cc:492] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: No bootstrap required, opened a new log
I20260809 22:49:48.809013 26641 ts_tablet_manager.cc:1397] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260809 22:49:48.809906 26641 raft_consensus.cc:348] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.810222 26641 raft_consensus.cc:374] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.810330 26641 raft_consensus.cc:729] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d980912622e4871b91821f88872a9df, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.808054 26645 ts_tablet_manager.cc:1428] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 22:49:48.810676 26648 tablet_bootstrap.cc:492] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: No bootstrap required, opened a new log
I20260809 22:49:48.810877 26648 ts_tablet_manager.cc:1397] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 22:49:48.810899 26641 consensus_queue.cc:260] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.811504 26651 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:48.811875 26651 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:48.812964 26641 ts_tablet_manager.cc:1428] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260809 22:49:48.815105 26648 raft_consensus.cc:348] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.815418 26648 raft_consensus.cc:374] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:48.815511 26648 raft_consensus.cc:729] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c17b14cf2144c794b58cb281e10ef8, State: Initialized, Role: FOLLOWER
I20260809 22:49:48.815790 26648 consensus_queue.cc:260] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.816390 26648 ts_tablet_manager.cc:1428] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260809 22:49:48.816352 26655 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:48.816733 26655 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:48.945257 26651 raft_consensus.cc:482] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:48.945537 26651 raft_consensus.cc:504] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.946224 26651 leader_election.cc:288] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925), 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.946928 26546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c4554ac9c454a739a8835d50f7b1780" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17b14cf2144c794b58cb281e10ef8" is_pre_election: true
I20260809 22:49:48.946929 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c4554ac9c454a739a8835d50f7b1780" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14837f61d9c54fbbb543f69b4c58023b" is_pre_election: true
I20260809 22:49:48.947247 26546 raft_consensus.cc:2454] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 0.
I20260809 22:49:48.947247 26110 raft_consensus.cc:2454] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 0.
I20260809 22:49:48.947734 26219 leader_election.cc:302] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14837f61d9c54fbbb543f69b4c58023b, 9d980912622e4871b91821f88872a9df; no voters:
I20260809 22:49:48.948051 26651 raft_consensus.cc:2781] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:48.948190 26651 raft_consensus.cc:482] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:48.948321 26651 raft_consensus.cc:3037] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.952656 26651 raft_consensus.cc:504] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.953387 26651 leader_election.cc:288] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 election: Requested vote from peers 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925), 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117)
I20260809 22:49:48.953938 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c4554ac9c454a739a8835d50f7b1780" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14837f61d9c54fbbb543f69b4c58023b"
I20260809 22:49:48.953974 26546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c4554ac9c454a739a8835d50f7b1780" candidate_uuid: "9d980912622e4871b91821f88872a9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17b14cf2144c794b58cb281e10ef8"
I20260809 22:49:48.954214 26546 raft_consensus.cc:3037] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.954223 26110 raft_consensus.cc:3037] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:48.956746 26110 raft_consensus.cc:2454] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 1.
I20260809 22:49:48.957243 26546 raft_consensus.cc:2454] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d980912622e4871b91821f88872a9df in term 1.
I20260809 22:49:48.957258 26219 leader_election.cc:302] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14837f61d9c54fbbb543f69b4c58023b, 9d980912622e4871b91821f88872a9df; no voters:
I20260809 22:49:48.957798 26651 raft_consensus.cc:2781] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:48.958033 26651 raft_consensus.cc:686] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [term 1 LEADER]: Becoming Leader. State: Replica: 9d980912622e4871b91821f88872a9df, State: Running, Role: LEADER
I20260809 22:49:48.958320 26651 consensus_queue.cc:237] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } }
I20260809 22:49:48.960259 26659 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: TxnStatusTablet state changed. Reason: New leader 9d980912622e4871b91821f88872a9df. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:48.960539 26659 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:49:48.961325 26704 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 22:49:48.961694 26704 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 22:49:48.962249 25849 catalog_manager.cc:5495] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d980912622e4871b91821f88872a9df (127.23.131.66). New cstate: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } health_report { overall_health: UNKNOWN } } }
I20260809 22:49:49.004498 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.998333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32780 (local address 127.23.131.66:40147)
0809 22:49:48.999049 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:48.999054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:48.999070 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:49:48.999129 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:48.999133 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:48.999253 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:48.999378 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:48.999835 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.000718 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.002164 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.002749 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.002891 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.003495 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:49.003613 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:49.003716 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.003947 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.004049 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":425,"threads_started":1}
I20260809 22:49:49.004993 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:48.998356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:40147 (local address 127.0.0.1:32780)
0809 22:49:48.998607 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:48.998630 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:48.998780 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:48.999408 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:48.999413 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:48.999426 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:48.999637 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:48.999647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.000857 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.000863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:49.002006 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:49.002021 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.002918 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.002924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:49.003168 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.003284 (+ 116us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:49.003770 (+ 486us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:49.003803 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 22:49:49.003897 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 22:49:49.004076 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 22:49:49.009990 26110 raft_consensus.cc:1261] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Refusing update from remote peer 9d980912622e4871b91821f88872a9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:49.010114 26546 raft_consensus.cc:1261] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Refusing update from remote peer 9d980912622e4871b91821f88872a9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:49.010855 26651 consensus_queue.cc:1035] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:49.011188 26659 consensus_queue.cc:1035] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:49.016469 26655 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: TxnStatusTablet state changed. Reason: New leader 9d980912622e4871b91821f88872a9df. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:49.016759 26655 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:49.019367 26707 mvcc.cc:205] Tried to move back new op lower bound from 7316749471778152448 to 7316749471575896064. Current Snapshot: MvccSnapshot[applied={T|T < 7316749471778152448}]
I20260809 22:49:49.024003 26655 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:49.024293 26655 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 03c17b14cf2144c794b58cb281e10ef8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:49.037305 26651 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:49.037724 26651 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:49:49.047278 26652 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: TxnStatusTablet state changed. Reason: New leader 9d980912622e4871b91821f88872a9df. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:49.047602 26652 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:49.050875 26659 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:49.051302 26659 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 9d980912622e4871b91821f88872a9df: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:49:49.063396 26652 tablet_replica.cc:439] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d980912622e4871b91821f88872a9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 } } peers { permanent_uuid: "9d980912622e4871b91821f88872a9df" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40147 } } peers { permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 } } }
I20260809 22:49:49.063712 26652 tablet_replica.cc:442] T 7c4554ac9c454a739a8835d50f7b1780 P 14837f61d9c54fbbb543f69b4c58023b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:49.074641 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.068538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:52621 (local address 127.23.131.66:40147)
0809 22:49:49.068746 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:49.068755 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:49.069434 (+ 679us) server_negotiation.cc:407] Connection header received
0809 22:49:49.069670 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:49.069674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:49.069754 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:49.069852 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:49.070399 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.071148 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.072752 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.073190 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.073345 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.073801 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:49.073916 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:49.074018 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.074165 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.074234 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:49:49.074869 26729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.068574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:40147 (local address 127.23.131.66:52621)
0809 22:49:49.069322 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:49.069339 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:49.069531 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:49.069877 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:49.069881 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:49.069890 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:49.070207 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:49.070217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.071334 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.071341 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:49.072584 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:49.072598 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.073400 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.073408 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:49.073534 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.073591 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:49.074017 (+ 426us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:49.074035 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 22:49:49.074135 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 22:49:49.074267 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":378,"threads_started":1}
I20260809 22:49:49.086004 26110 raft_consensus.cc:1261] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Refusing update from remote peer 9d980912622e4871b91821f88872a9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:49.086089 26546 raft_consensus.cc:1261] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Refusing update from remote peer 9d980912622e4871b91821f88872a9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:49.086696 26722 consensus_queue.cc:1035] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "14837f61d9c54fbbb543f69b4c58023b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:49.087144 26651 consensus_queue.cc:1035] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c17b14cf2144c794b58cb281e10ef8" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:49.093822 26708 mvcc.cc:205] Tried to move back new op lower bound from 7316749472090124288 to 7316749470523805696. Current Snapshot: MvccSnapshot[applied={T|T < 7316749472090124288}]
I20260809 22:49:49.168088 25850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:49.168401 25850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:49.171772 25850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e90055b6ca50475b9f31a279601921da: Sending DeleteTablet for 3 replicas of tablet ff1f1e689ef547d5a127aad101fb8869
I20260809 22:49:49.172940 26066 tablet_service.cc:1514] Processing DeleteTablet for tablet ff1f1e689ef547d5a127aad101fb8869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:49 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55238
I20260809 22:49:49.173194 26506 tablet_service.cc:1514] Processing DeleteTablet for tablet ff1f1e689ef547d5a127aad101fb8869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:49 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:48756
I20260809 22:49:49.174492 26297 tablet_service.cc:1514] Processing DeleteTablet for tablet ff1f1e689ef547d5a127aad101fb8869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:49 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:60996
I20260809 22:49:49.184296 26739 tablet_replica.cc:330] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: stopping tablet replica
I20260809 22:49:49.184813 26739 raft_consensus.cc:2229] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:49.185304 26739 raft_consensus.cc:2258] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:49.186944 26739 ts_tablet_manager.cc:1905] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:49.190672 26742 tablet_replica.cc:330] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: stopping tablet replica
I20260809 22:49:49.190963 26742 raft_consensus.cc:2229] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:49:49.191790 26742 raft_consensus.cc:2258] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:49.193490 26742 ts_tablet_manager.cc:1905] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:49.203022 26742 ts_tablet_manager.cc:1918] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:49.203357 26742 log.cc:1196] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/ff1f1e689ef547d5a127aad101fb8869
I20260809 22:49:49.203934 26742 ts_tablet_manager.cc:1939] T ff1f1e689ef547d5a127aad101fb8869 P 9d980912622e4871b91821f88872a9df: Deleting consensus metadata
I20260809 22:49:49.204015 26737 tablet_replica.cc:330] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: stopping tablet replica
I20260809 22:49:49.204257 26737 raft_consensus.cc:2229] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:49.204562 26737 raft_consensus.cc:2258] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:49.205399 25835 catalog_manager.cc:4841] TS 9d980912622e4871b91821f88872a9df (127.23.131.66:40147): tablet ff1f1e689ef547d5a127aad101fb8869 (table test-table [id=f83d651244fc4b2a9287b13bc6a0b40e]) successfully deleted
I20260809 22:49:49.208179 26737 ts_tablet_manager.cc:1905] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:49.211074 26739 ts_tablet_manager.cc:1918] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:49.211292 26739 log.cc:1196] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/ff1f1e689ef547d5a127aad101fb8869
I20260809 22:49:49.211795 26739 ts_tablet_manager.cc:1939] T ff1f1e689ef547d5a127aad101fb8869 P 03c17b14cf2144c794b58cb281e10ef8: Deleting consensus metadata
I20260809 22:49:49.213145 25834 catalog_manager.cc:4841] TS 03c17b14cf2144c794b58cb281e10ef8 (127.23.131.67:40117): tablet ff1f1e689ef547d5a127aad101fb8869 (table test-table [id=f83d651244fc4b2a9287b13bc6a0b40e]) successfully deleted
I20260809 22:49:49.216075 26737 ts_tablet_manager.cc:1918] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:49.216239 26737 log.cc:1196] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/ff1f1e689ef547d5a127aad101fb8869
I20260809 22:49:49.216804 26737 ts_tablet_manager.cc:1939] T ff1f1e689ef547d5a127aad101fb8869 P 14837f61d9c54fbbb543f69b4c58023b: Deleting consensus metadata
I20260809 22:49:49.218137 25834 catalog_manager.cc:4841] TS 14837f61d9c54fbbb543f69b4c58023b (127.23.131.65:39925): tablet ff1f1e689ef547d5a127aad101fb8869 (table test-table [id=f83d651244fc4b2a9287b13bc6a0b40e]) successfully deleted
Aug 09 22:49:49 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:49.227632 26743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.187932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55250 (local address 127.23.131.65:39925)
0809 22:49:49.207638 (+ 19706us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:49.207644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:49.207665 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:49:49.207730 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:49.207736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:49.207819 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:49.207950 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:49.210204 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.211983 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.214395 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.215116 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.215285 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.220890 (+ 5605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:49.220905 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:49.220921 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:49.220958 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:49.224114 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.225125 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.225134 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.225136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.225393 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.225853 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.225858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.225861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.226268 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:49.226596 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.226947 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.227263 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19576,"thread_start_us":23205,"threads_started":1}
W20260809 22:49:49.228555 26175 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55250
I20260809 22:49:49.245944 26694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.231640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36924 (local address 127.23.131.126:41517)
0809 22:49:49.231908 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:49.231913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:49.232100 (+ 187us) server_negotiation.cc:407] Connection header received
0809 22:49:49.232235 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:49.232241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:49.232360 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:49.232473 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:49.233780 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.234926 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.236288 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.236981 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.237116 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.239558 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:49.239565 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:49.239571 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:49.239613 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:49.243293 (+ 3680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.243967 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.243973 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.243977 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.244135 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.244532 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.244537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.244541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.244883 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:49.245125 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.245415 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.245639 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
W20260809 22:49:49.246656 25850 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36924
I20260809 22:49:49.248888 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25966
I20260809 22:49:49.264138 26743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.250109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55252 (local address 127.23.131.65:39925)
0809 22:49:49.250292 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:49.250298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:49.250320 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:49:49.250528 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:49.250536 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:49.250617 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:49.250750 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:49.252127 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.253280 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.254690 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.255364 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.255506 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.257731 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:49.257737 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:49.257760 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:49.257800 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:49.261298 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.262083 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.262090 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.262094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.262256 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.262616 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.262622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.262626 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.262977 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:49.263355 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.263540 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.263784 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 22:49:49.264789 26175 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55252
W20260809 22:49:49.265407 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25966: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:49:49.265628 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25966
I20260809 22:49:49.298322 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26187
Aug 09 22:49:49 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:49:49.317993 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.299506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32796 (local address 127.23.131.66:40147)
0809 22:49:49.299877 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:49.299890 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:49.299911 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:49:49.299980 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:49.299987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:49.300106 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:49.300225 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:49.302033 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.302902 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.304802 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.305314 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.305419 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.311010 (+ 5591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:49.311027 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:49.311043 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:49.311134 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:49.314733 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.315625 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.315633 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.315635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.315804 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.316249 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.316252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.316254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.316673 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:49.317015 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.317453 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.317631 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209}
W20260809 22:49:49.318871 26394 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32796
W20260809 22:49:49.319661 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26187: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:49:49.319851 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26187
I20260809 22:49:49.361801 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26406
Aug 09 22:49:49 dist-test-slave-92m1 krb5kdc[25789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:49:49.378479 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:49.362753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.23.131.67:40117)
0809 22:49:49.363338 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:49.363343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:49.363362 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:49:49.363420 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:49.363423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:49.363506 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:49.363603 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:49.364923 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.365661 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.366869 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:49.367486 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:49.367601 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:49.372280 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:49.372298 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:49.372314 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:49.372352 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:49.375480 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.376217 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.376225 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.376227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.376389 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:49.376786 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:49.376791 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:49.376794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:49.377189 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:49.377518 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:49.377843 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 22:49:49.378104 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":286,"threads_started":1}
W20260809 22:49:49.379336 26607 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48770
W20260809 22:49:49.380038 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26406: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:49:49.380218 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26406
I20260809 22:49:49.405745 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25805
I20260809 22:49:49.406958 25915 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:49.528929 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25805
2026-08-09T22:49:49Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5478 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:49:49 dist-test-slave-92m1 krb5kdc[26756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:49:49 dist-test-slave-92m1 krb5kdc[26756](info): set up 2 sockets
Aug 09 22:49:49 dist-test-slave-92m1 krb5kdc[26756](info): commencing operation
krb5kdc: starting...
W20260809 22:49:50.881135 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:49:51 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:49:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:49:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:49:51.132198 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40301
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:43057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:40301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:51.479665 26775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:51.479995 26775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:51.480170 26775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:51.487614 26775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:49:51.487726 26775 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 22:49:51.487833 26775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:51.487948 26775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:51.488061 26775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:49:51.488173 26775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:49:51.498328 26775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:43057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:40301
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:51.499759 26775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:51.501153 26775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:51.513908 26780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:51.513991 26781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:51.513960 26785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:51.515570 26775 server_base.cc:1034] running on GCE node
I20260809 22:49:51.516458 26775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:51.518028 26775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:51.519323 26775 hybrid_clock.cc:648] HybridClock initialized: now 1786315791519264 us; error 43 us; skew 500 ppm
I20260809 22:49:51.519703 26775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:51 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:51.523053 26775 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:49:51.524838 26775 webserver.cc:460] Webserver started at http://127.23.131.126:38727/ using document root <none> and password file <none>
I20260809 22:49:51.525622 26775 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:51.525763 26775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:51.526129 26775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:51.529426 26775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c1f16482993346df9601c6ee4f8aad0c"
format_stamp: "Formatted at 2026-08-09 22:49:51 on dist-test-slave-92m1"
server_key: "c628c464975ddf5f5ee3c4cad8295ea9"
server_key_iv: "c904c812b448dc9ce74f57a02859e7a3"
server_key_version: "encryptionkey@0"
I20260809 22:49:51.530289 26775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c1f16482993346df9601c6ee4f8aad0c"
format_stamp: "Formatted at 2026-08-09 22:49:51 on dist-test-slave-92m1"
server_key: "c628c464975ddf5f5ee3c4cad8295ea9"
server_key_iv: "c904c812b448dc9ce74f57a02859e7a3"
server_key_version: "encryptionkey@0"
I20260809 22:49:51.536212 26775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 22:49:51.540016 26797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:51.541884 26775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:49:51.542114 26775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c1f16482993346df9601c6ee4f8aad0c"
format_stamp: "Formatted at 2026-08-09 22:49:51 on dist-test-slave-92m1"
server_key: "c628c464975ddf5f5ee3c4cad8295ea9"
server_key_iv: "c904c812b448dc9ce74f57a02859e7a3"
server_key_version: "encryptionkey@0"
I20260809 22:49:51.542412 26775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:51.563530 26775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:51.568207 26775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:51.568454 26775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:51.592087 26775 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:40301
I20260809 22:49:51.592108 26884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:40301 every 8 connection(s)
I20260809 22:49:51.593572 26775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:49:51.597524 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:51.598220 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26775
I20260809 22:49:51.598438 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:49:51.599113 24077 external_mini_cluster.cc:1428] Setting key ec02ee4ebd77f57574c9eee0f2037483
I20260809 22:49:51.613283 26885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Bootstrap starting.
Aug 09 22:49:51 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:51.617156 26885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:51.618734 26885 log.cc:824] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:51.622347 26885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: No bootstrap required, opened a new log
I20260809 22:49:51.625888 26891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:51.601254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34632 (local address 127.23.131.126:40301)
0809 22:49:51.602235 (+ 981us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:51.602253 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:51.602307 (+ 54us) server_negotiation.cc:407] Connection header received
0809 22:49:51.604861 (+ 2554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:51.604892 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:51.605479 (+ 587us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:51.605987 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:51.607429 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:51.609486 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:51.610852 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:51.612003 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:51.612201 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:51.616756 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:51.616769 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:51.616791 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:51.616852 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:51.620939 (+ 4087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:51.621716 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:51.621726 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:51.621735 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:51.621996 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:51.622387 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:51.622395 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:51.622400 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:51.623172 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:51.623499 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:51.623889 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 22:49:51.624370 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":411,"threads_started":1}
I20260809 22:49:51.631707 26885 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f16482993346df9601c6ee4f8aad0c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40301 } }
I20260809 22:49:51.632091 26885 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:51.632169 26885 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f16482993346df9601c6ee4f8aad0c, State: Initialized, Role: FOLLOWER
I20260809 22:49:51.632853 26885 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f16482993346df9601c6ee4f8aad0c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40301 } }
I20260809 22:49:51.633155 26885 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:49:51.633317 26885 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:49:51.633520 26885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:51.635922 26885 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f16482993346df9601c6ee4f8aad0c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40301 } }
I20260809 22:49:51.636497 26885 leader_election.cc:302] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1f16482993346df9601c6ee4f8aad0c; no voters:
I20260809 22:49:51.637148 26885 leader_election.cc:288] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:49:51.637300 26894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:51.638049 26894 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [term 1 LEADER]: Becoming Leader. State: Replica: c1f16482993346df9601c6ee4f8aad0c, State: Running, Role: LEADER
I20260809 22:49:51.638644 26894 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f16482993346df9601c6ee4f8aad0c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40301 } }
I20260809 22:49:51.639518 26885 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:49:51.641592 26896 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1f16482993346df9601c6ee4f8aad0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f16482993346df9601c6ee4f8aad0c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40301 } } }
I20260809 22:49:51.642092 26896 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:51.643275 26897 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1f16482993346df9601c6ee4f8aad0c. Latest consensus state: current_term: 1 leader_uuid: "c1f16482993346df9601c6ee4f8aad0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1f16482993346df9601c6ee4f8aad0c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40301 } } }
I20260809 22:49:51.643671 26897 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c [sys.catalog]: This master's current role is: LEADER
I20260809 22:49:51.645241 26908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:49:51.650965 26908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:49:51.660677 26908 catalog_manager.cc:1347] Generated new cluster ID: dbac2be09acd4847acbaf72ee7f621f7
I20260809 22:49:51.660809 26908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:49:51.676666 26908 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:49:51.678649 26908 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:49:51.687626 26908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Generated new TSK 0
I20260809 22:49:51.688712 26908 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:49:51.756537 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40301
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:43057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:52.109364 26928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:52.109674 26928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:52.109786 26928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:52.117364 26928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:52.117499 26928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:52.117606 26928 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 22:49:52.117660 26928 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:49:52.117736 26928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:49:52.128342 26928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:43057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:52.129724 26928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:52.131167 26928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:52.145814 26937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:52.145910 26935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:52.145867 26934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:52.146878 26928 server_base.cc:1034] running on GCE node
I20260809 22:49:52.147593 26928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:52.148656 26928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:52.149871 26928 hybrid_clock.cc:648] HybridClock initialized: now 1786315792149802 us; error 66 us; skew 500 ppm
I20260809 22:49:52.150234 26928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:52 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315792, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:52.157152 26928 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:49:52.158864 26928 webserver.cc:460] Webserver started at http://127.23.131.65:33615/ using document root <none> and password file <none>
I20260809 22:49:52.159708 26928 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:52.159873 26928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:52.160221 26928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:52.163419 26928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "63067f7fc8d741e29c48716b770f467a"
format_stamp: "Formatted at 2026-08-09 22:49:52 on dist-test-slave-92m1"
server_key: "7b3f8baf7eabb10c2c85a0b79b95b8d0"
server_key_iv: "6ff4aa30c8a8e8fdbc5ecf601eed59e8"
server_key_version: "encryptionkey@0"
I20260809 22:49:52.164268 26928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "63067f7fc8d741e29c48716b770f467a"
format_stamp: "Formatted at 2026-08-09 22:49:52 on dist-test-slave-92m1"
server_key: "7b3f8baf7eabb10c2c85a0b79b95b8d0"
server_key_iv: "6ff4aa30c8a8e8fdbc5ecf601eed59e8"
server_key_version: "encryptionkey@0"
I20260809 22:49:52.169914 26928 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:49:52.173695 26956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:52.175148 26928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 22:49:52.175443 26928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "63067f7fc8d741e29c48716b770f467a"
format_stamp: "Formatted at 2026-08-09 22:49:52 on dist-test-slave-92m1"
server_key: "7b3f8baf7eabb10c2c85a0b79b95b8d0"
server_key_iv: "6ff4aa30c8a8e8fdbc5ecf601eed59e8"
server_key_version: "encryptionkey@0"
I20260809 22:49:52.175683 26928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:52.191782 26928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:52.196430 26928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:52.196760 26928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:52.199719 26928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:52.199874 26928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:52.200045 26928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:52.200181 26928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:49:52 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315792, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:52.224825 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.200211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:40089 (local address 127.23.131.126:40301)
0809 22:49:52.200782 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:52.200789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:52.202004 (+ 1215us) server_negotiation.cc:407] Connection header received
0809 22:49:52.204217 (+ 2213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:52.204226 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:52.204343 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:52.204483 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:52.206708 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.208094 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.210806 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.211473 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.211637 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.216667 (+ 5030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:52.216674 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:52.216679 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:52.216727 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:52.220579 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.221740 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.221747 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.221751 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.221897 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.222396 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.222404 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.222407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.222705 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:52.222868 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:52.223751 (+ 883us) server_negotiation.cc:299] Negotiation successful
0809 22:49:52.223997 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":265,"threads_started":1}
I20260809 22:49:52.226433 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.200877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.23.131.65:40089)
0809 22:49:52.201823 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:52.201871 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:52.203891 (+ 2020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:52.204757 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:52.204765 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:52.205539 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:52.206413 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.206433 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.208279 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.208290 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.210639 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.210652 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.211773 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.211784 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.212212 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.213106 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:52.213147 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:52.216364 (+ 3217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:52.220789 (+ 4425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.220800 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.220827 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.221591 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.222035 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.222039 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.222042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.222271 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.222854 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:52.222863 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:52.223326 (+ 463us) client_negotiation.cc:769] Sending connection context
0809 22:49:52.223649 (+ 323us) client_negotiation.cc:240] Negotiation successful
0809 22:49:52.224287 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":392,"threads_started":1}
I20260809 22:49:52.255275 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.238269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.23.131.65:36429)
0809 22:49:52.238973 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:52.239005 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:52.239144 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:52.239797 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:52.239806 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:52.240711 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:52.241171 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.241194 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.242454 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.242463 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.244746 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.244764 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.245619 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.245629 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.245900 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.246685 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:52.246718 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:52.248284 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:52.251834 (+ 3550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.251847 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.251860 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.252762 (+ 902us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.253328 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.253335 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.253345 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.253498 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.254273 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:52.254276 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:52.254451 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 22:49:52.254570 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 22:49:52.254850 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":381,"threads_started":1}
I20260809 22:49:52.255618 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.238282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:36429 (local address 127.23.131.126:40301)
0809 22:49:52.238546 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:52.238556 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:52.239090 (+ 534us) server_negotiation.cc:407] Connection header received
0809 22:49:52.239306 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:52.239315 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:52.239416 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:52.239543 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:52.241376 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.242282 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.244932 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.245385 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.245489 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.248518 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:52.248558 (+ 40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:52.248562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:52.248609 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:52.251640 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.252962 (+ 1322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.252970 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.252973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.253181 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.253622 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.253630 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.253636 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.254137 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:52.254334 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:52.254736 (+ 402us) server_negotiation.cc:299] Negotiation successful
0809 22:49:52.255060 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 22:49:52.261929 26928 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:44509
I20260809 22:49:52.262030 27153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:44509 every 8 connection(s)
I20260809 22:49:52.263269 26928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:49:52.265443 27154 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40301
I20260809 22:49:52.265694 27154 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:52.266413 27154 heartbeater.cc:511] Master 127.23.131.126:40301 requested a full tablet report, sending...
I20260809 22:49:52.268505 26822 ts_manager.cc:194] Registered new tserver with Master: 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509)
I20260809 22:49:52.269951 26822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:40089
I20260809 22:49:52.273516 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26928
I20260809 22:49:52.273752 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:49:52.274412 24077 external_mini_cluster.cc:1428] Setting key 5115a18554819b2606af8a9db1bf92fa
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:49:52.331910 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40301
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:43057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:52.678136 27160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:52.678467 27160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:52.678651 27160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:52.686304 27160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:52.686460 27160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:52.686622 27160 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 22:49:52.686717 27160 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:49:52.686868 27160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:49:52.696880 27160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:43057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:52.698261 27160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:52.699648 27160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:52.713501 27168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:52.713536 27170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:52.714108 27174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:52.714218 27160 server_base.cc:1034] running on GCE node
I20260809 22:49:52.714882 27160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:52.715917 27160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:52.717164 27160 hybrid_clock.cc:648] HybridClock initialized: now 1786315792717121 us; error 63 us; skew 500 ppm
I20260809 22:49:52.717490 27160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:52 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315792, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:52.720697 27160 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:49:52.722110 27160 webserver.cc:460] Webserver started at http://127.23.131.66:44791/ using document root <none> and password file <none>
I20260809 22:49:52.722784 27160 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:52.722951 27160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:52.723336 27160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:52.726251 27160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "3766ef82ca30420ca014698c3fb51cf7"
format_stamp: "Formatted at 2026-08-09 22:49:52 on dist-test-slave-92m1"
server_key: "977e5a87201199abea8e1474261a31ba"
server_key_iv: "9156928e8b62c305809ebf27874d03bd"
server_key_version: "encryptionkey@0"
I20260809 22:49:52.727015 27160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "3766ef82ca30420ca014698c3fb51cf7"
format_stamp: "Formatted at 2026-08-09 22:49:52 on dist-test-slave-92m1"
server_key: "977e5a87201199abea8e1474261a31ba"
server_key_iv: "9156928e8b62c305809ebf27874d03bd"
server_key_version: "encryptionkey@0"
I20260809 22:49:52.732195 27160 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 22:49:52.735620 27183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:52.736874 27160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:49:52.737058 27160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "3766ef82ca30420ca014698c3fb51cf7"
format_stamp: "Formatted at 2026-08-09 22:49:52 on dist-test-slave-92m1"
server_key: "977e5a87201199abea8e1474261a31ba"
server_key_iv: "9156928e8b62c305809ebf27874d03bd"
server_key_version: "encryptionkey@0"
I20260809 22:49:52.737274 27160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:52.756459 27160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:52.761164 27160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:52.761483 27160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:52.764365 27160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:52.764485 27160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:52.764621 27160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:52.764737 27160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:49:52 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315792, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:52.791343 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.765006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:56101 (local address 127.23.131.126:40301)
0809 22:49:52.767473 (+ 2467us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:52.767481 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:52.767510 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:49:52.769384 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:52.769393 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:52.769507 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:52.769674 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:52.771977 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.773391 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.776035 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.776909 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.777071 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.783194 (+ 6123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:52.783226 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:52.783231 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:52.783278 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:52.786749 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.787845 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.787853 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.787857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.788035 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.788769 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.788774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.788777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.789177 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:52.789348 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:52.790641 (+ 1293us) server_negotiation.cc:299] Negotiation successful
0809 22:49:52.790929 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2328,"thread_start_us":2219,"threads_started":1}
I20260809 22:49:52.792807 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.765605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.23.131.66:56101)
0809 22:49:52.766713 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:52.766776 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:52.769009 (+ 2233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:52.770000 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:52.770012 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:52.770839 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:52.771757 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.771791 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.773571 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.773579 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.775871 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.775884 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.777481 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.777489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.777921 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.778839 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:52.778882 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:52.782885 (+ 4003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:52.786912 (+ 4027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.786922 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.786945 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.787650 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.788179 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.788187 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.788193 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.788641 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.789462 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:52.789473 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:52.790121 (+ 648us) client_negotiation.cc:769] Sending connection context
0809 22:49:52.790531 (+ 410us) client_negotiation.cc:240] Negotiation successful
0809 22:49:52.791148 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":454,"threads_started":1}
I20260809 22:49:52.807626 27160 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:43867
I20260809 22:49:52.807690 27387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:43867 every 8 connection(s)
I20260809 22:49:52.809125 27160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:49:52.811847 27389 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40301
I20260809 22:49:52.812103 27389 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:52.812806 27389 heartbeater.cc:511] Master 127.23.131.126:40301 requested a full tablet report, sending...
I20260809 22:49:52.814327 26822 ts_manager.cc:194] Registered new tserver with Master: 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867)
I20260809 22:49:52.815497 26822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:56101
I20260809 22:49:52.816906 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.801153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.23.131.66:39053)
0809 22:49:52.802257 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:52.802279 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:52.802546 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:52.803182 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:52.803186 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:52.804086 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:52.804483 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.804495 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.805883 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.805887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.807325 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:52.807338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.808213 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.808221 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:52.808399 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.809042 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:52.809059 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:52.809995 (+ 936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:52.813994 (+ 3999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.813998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.814001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.814382 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.814831 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:52.814834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:52.814836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:52.814961 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:52.815802 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:52.815808 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:52.816039 (+ 231us) client_negotiation.cc:769] Sending connection context
0809 22:49:52.816219 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 22:49:52.816546 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":563,"threads_started":1}
I20260809 22:49:52.816952 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:52.801079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:39053 (local address 127.23.131.126:40301)
0809 22:49:52.801349 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:52.801355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:52.802382 (+ 1027us) server_negotiation.cc:407] Connection header received
0809 22:49:52.802756 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:52.802764 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:52.802883 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:52.803005 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:52.804741 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.805728 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.807481 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:52.807998 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:52.808135 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:52.810263 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:52.810272 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:52.810278 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:52.810324 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:52.813836 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.814564 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.814569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.814572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.814714 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:52.815076 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:52.815085 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:52.815088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:52.815578 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:52.815731 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:52.816355 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 22:49:52.816613 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":81}
I20260809 22:49:52.817785 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27160
I20260809 22:49:52.817986 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:49:52.818586 24077 external_mini_cluster.cc:1428] Setting key bd5470ad0a3bb381c0a43e5e0c301b90
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:49:52.871474 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40301
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:43057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:49:53.223105 27395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:49:53.223510 27395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:49:53.223721 27395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:49:53.231634 27395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:49:53.231747 27395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:49:53.231930 27395 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 22:49:53.232012 27395 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:49:53.232147 27395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:49:53.242969 27395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:43057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:49:53.244558 27395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:49:53.245947 27395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:49:53.259992 27400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:53.260042 27401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:49:53.260262 27403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:49:53.261152 27395 server_base.cc:1034] running on GCE node
I20260809 22:49:53.261953 27395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:49:53.262953 27395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:49:53.264185 27395 hybrid_clock.cc:648] HybridClock initialized: now 1786315793264141 us; error 38 us; skew 500 ppm
I20260809 22:49:53.264510 27395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:49:53 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315793, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:49:53.268199 27395 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:49:53.269783 27395 webserver.cc:460] Webserver started at http://127.23.131.67:35589/ using document root <none> and password file <none>
I20260809 22:49:53.270488 27395 fs_manager.cc:359] Metadata directory not provided
I20260809 22:49:53.270658 27395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:49:53.270993 27395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:49:53.272722 27154 heartbeater.cc:503] Master 127.23.131.126:40301 was elected leader, sending a full tablet report...
I20260809 22:49:53.274323 27395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "4b89006aec04481ea9204ed77396c017"
format_stamp: "Formatted at 2026-08-09 22:49:53 on dist-test-slave-92m1"
server_key: "eb1d5a149e2947bc85ef559e6c685c19"
server_key_iv: "be4e93fcfd87682def657bac994336f7"
server_key_version: "encryptionkey@0"
I20260809 22:49:53.275300 27395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "4b89006aec04481ea9204ed77396c017"
format_stamp: "Formatted at 2026-08-09 22:49:53 on dist-test-slave-92m1"
server_key: "eb1d5a149e2947bc85ef559e6c685c19"
server_key_iv: "be4e93fcfd87682def657bac994336f7"
server_key_version: "encryptionkey@0"
I20260809 22:49:53.281208 27395 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 22:49:53.285172 27417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:53.286476 27395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:49:53.286666 27395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "4b89006aec04481ea9204ed77396c017"
format_stamp: "Formatted at 2026-08-09 22:49:53 on dist-test-slave-92m1"
server_key: "eb1d5a149e2947bc85ef559e6c685c19"
server_key_iv: "be4e93fcfd87682def657bac994336f7"
server_key_version: "encryptionkey@0"
I20260809 22:49:53.286876 27395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:49:53.302497 27395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:49:53.306878 27395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:49:53.307302 27395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:49:53.310447 27395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:49:53.310617 27395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:49:53.310995 27395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:49:53.311183 27395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:49:53 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315793, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:53.336875 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.310680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:51919 (local address 127.23.131.126:40301)
0809 22:49:53.310891 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.310895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.312589 (+ 1694us) server_negotiation.cc:407] Connection header received
0809 22:49:53.315464 (+ 2875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.315470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.315569 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.315688 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:53.317808 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.319230 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.322879 (+ 3649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.323371 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.323538 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.328380 (+ 4842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:53.328385 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:53.328388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:53.328424 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:53.331590 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.333071 (+ 1481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.333079 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.333086 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.333303 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.334204 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.334213 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.334219 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.334724 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:53.334922 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.336217 (+ 1295us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.336500 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 22:49:53.338579 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.311374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.23.131.67:51919)
0809 22:49:53.312375 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.312428 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.315074 (+ 2646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.316146 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.316154 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.316657 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:53.317545 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.317571 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.319532 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.319542 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.322655 (+ 3113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.322682 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.323671 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.323680 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.323913 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.324643 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:53.324666 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:53.328089 (+ 3423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:53.331800 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:53.331814 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:53.331834 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:53.332823 (+ 989us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:53.333498 (+ 675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:53.333507 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:53.333514 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:53.333961 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:53.334931 (+ 970us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:53.334941 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:53.335393 (+ 452us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.335749 (+ 356us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.337463 (+ 1714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":734,"threads_started":1}
I20260809 22:49:53.369925 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.352708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:34013 (local address 127.23.131.126:40301)
0809 22:49:53.352900 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.352906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.353279 (+ 373us) server_negotiation.cc:407] Connection header received
0809 22:49:53.353548 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.353552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.353617 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.353697 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:53.355621 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.356463 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.359356 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.359924 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.360083 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.363378 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:53.363382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:53.363386 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:53.363419 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:53.366120 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.367219 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.367228 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.367233 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.367417 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.367950 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.367959 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.367965 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.368444 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:53.368628 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.369285 (+ 657us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.369543 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 22:49:53.370070 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.352138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.23.131.67:34013)
0809 22:49:53.353121 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.353159 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.353384 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.353787 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.353796 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.354771 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:53.355421 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.355443 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.356640 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.356649 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.359109 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.359142 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.360190 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.360202 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.360474 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.361536 (+ 1062us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:53.361575 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:53.363114 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:53.366261 (+ 3147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:53.366269 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:53.366276 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:53.367019 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:53.367557 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:53.367563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:53.367566 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:53.367765 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:53.368619 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:53.368626 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:53.368895 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.369087 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.369482 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":512,"threads_started":1}
I20260809 22:49:53.381659 27395 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:46119
I20260809 22:49:53.381705 27605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:46119 every 8 connection(s)
I20260809 22:49:53.383035 27395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:49:53.385397 27606 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40301
I20260809 22:49:53.385673 27606 heartbeater.cc:464] Registering TS with master...
I20260809 22:49:53.386428 27606 heartbeater.cc:511] Master 127.23.131.126:40301 requested a full tablet report, sending...
I20260809 22:49:53.387357 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27395
I20260809 22:49:53.387569 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:49:53.387951 26822 ts_manager.cc:194] Registered new tserver with Master: 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:53.388075 24077 external_mini_cluster.cc:1428] Setting key c137703eb4036d96afc57fb446427633
I20260809 22:49:53.388908 26822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:51919
I20260809 22:49:53.391531 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 22:49:53 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 22:49:53 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:53.452630 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.437339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34644 (local address 127.23.131.126:40301)
0809 22:49:53.437621 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.437630 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.437982 (+ 352us) server_negotiation.cc:407] Connection header received
0809 22:49:53.438153 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.438158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.438235 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.438336 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:53.440007 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.441065 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.442526 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.443003 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.443104 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.447293 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:53.447297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:53.447301 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:53.447337 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:53.450166 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.450775 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.450779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.450781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.450911 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.451322 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.451325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.451327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.451614 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:53.451829 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.452069 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.452244 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:49:53.456984 26822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:53.464238 26822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:53.489660 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.478034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44498 (local address 127.23.131.66:43867)
0809 22:49:53.479416 (+ 1382us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.479425 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.479454 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:49:53.479552 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.479558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.479789 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.481022 (+ 1233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.481296 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.483283 (+ 1987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.486966 (+ 3683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.488298 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.488426 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.488642 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.489131 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.489313 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1231,"thread_start_us":1069,"threads_started":1}
I20260809 22:49:53.489866 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.477513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:43867 (local address 127.0.0.1:44498)
0809 22:49:53.478676 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.478695 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.478816 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.480048 (+ 1232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.480060 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.480099 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.480735 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.480754 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.483481 (+ 2727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.483491 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.486769 (+ 3278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.486784 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.488533 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.488539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.488802 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.488885 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.489055 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.489266 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1032,"mutex_wait_us":806,"thread_start_us":716,"threads_started":1}
I20260809 22:49:53.489892 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.477141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.0.0.1:41046)
0809 22:49:53.478531 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.478574 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.478769 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.480052 (+ 1283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.480060 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.480256 (+ 196us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.480903 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.480920 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.483510 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.483519 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.486505 (+ 2986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.486529 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.488801 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.488805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.489001 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.489065 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.489163 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.489304 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"mutex_wait_us":88,"thread_start_us":1269,"threads_started":1}
I20260809 22:49:53.490893 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.477322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41046 (local address 127.23.131.65:44509)
0809 22:49:53.478053 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.478066 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.478961 (+ 895us) server_negotiation.cc:407] Connection header received
0809 22:49:53.479092 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.479144 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.479431 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.479673 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.481251 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.483282 (+ 2031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.486703 (+ 3421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.488284 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.488441 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.488644 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.490355 (+ 1711us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.490594 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":318,"threads_started":1}
I20260809 22:49:53.493808 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.479174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46119 (local address 127.0.0.1:58956)
0809 22:49:53.484643 (+ 5469us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.484667 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.484811 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.485929 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.485934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.485959 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.486492 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.486501 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.488392 (+ 1891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.488400 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.491042 (+ 2642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.491058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.492933 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.492940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.493131 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.493171 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.493282 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.493415 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5260,"mutex_wait_us":3,"thread_start_us":5067,"threads_started":1}
I20260809 22:49:53.493824 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.479881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58956 (local address 127.23.131.67:46119)
0809 22:49:53.485452 (+ 5571us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.485458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.485483 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:49:53.485572 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.485578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.485741 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.485950 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.486697 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.488253 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.491273 (+ 3020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.492697 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.492859 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.493104 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.493328 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.493499 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5420,"thread_start_us":5234,"threads_started":1}
I20260809 22:49:53.494321 27041 tablet_service.cc:1467] Processing CreateTablet for tablet a76f7e880c8d4f578369fe64e539f54a (DEFAULT_TABLE table=test-table [id=a0a9ca7d5d32485291e2a19b6434001b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:53.494321 27262 tablet_service.cc:1467] Processing CreateTablet for tablet a76f7e880c8d4f578369fe64e539f54a (DEFAULT_TABLE table=test-table [id=a0a9ca7d5d32485291e2a19b6434001b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:53.495882 27041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a76f7e880c8d4f578369fe64e539f54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:53.495882 27262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a76f7e880c8d4f578369fe64e539f54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:53.497260 27499 tablet_service.cc:1467] Processing CreateTablet for tablet a76f7e880c8d4f578369fe64e539f54a (DEFAULT_TABLE table=test-table [id=a0a9ca7d5d32485291e2a19b6434001b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:53.498399 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a76f7e880c8d4f578369fe64e539f54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:53.511180 27637 tablet_bootstrap.cc:492] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Bootstrap starting.
I20260809 22:49:53.513684 27634 tablet_bootstrap.cc:492] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Bootstrap starting.
I20260809 22:49:53.514842 27636 tablet_bootstrap.cc:492] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Bootstrap starting.
I20260809 22:49:53.517246 27634 tablet_bootstrap.cc:654] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:53.517371 27637 tablet_bootstrap.cc:654] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:53.518338 27636 tablet_bootstrap.cc:654] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:53.518359 27634 log.cc:824] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:53.518716 27637 log.cc:824] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:53.519611 27636 log.cc:824] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Log is configured to *not* fsync() on all Append() calls
I20260809 22:49:53.521631 27634 tablet_bootstrap.cc:492] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: No bootstrap required, opened a new log
I20260809 22:49:53.521914 27634 ts_tablet_manager.cc:1397] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 22:49:53.522642 27636 tablet_bootstrap.cc:492] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: No bootstrap required, opened a new log
I20260809 22:49:53.522960 27636 ts_tablet_manager.cc:1397] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20260809 22:49:53.523056 27637 tablet_bootstrap.cc:492] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: No bootstrap required, opened a new log
I20260809 22:49:53.523900 27637 ts_tablet_manager.cc:1397] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20260809 22:49:53.529870 27634 raft_consensus.cc:348] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.530264 27634 raft_consensus.cc:374] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:53.530416 27634 raft_consensus.cc:729] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b89006aec04481ea9204ed77396c017, State: Initialized, Role: FOLLOWER
I20260809 22:49:53.531050 27634 consensus_queue.cc:260] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.532303 27606 heartbeater.cc:503] Master 127.23.131.126:40301 was elected leader, sending a full tablet report...
I20260809 22:49:53.532828 27634 ts_tablet_manager.cc:1428] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260809 22:49:53.534584 27637 raft_consensus.cc:348] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.535027 27637 raft_consensus.cc:374] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:53.535130 27637 raft_consensus.cc:729] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Initialized, Role: FOLLOWER
I20260809 22:49:53.535758 27637 consensus_queue.cc:260] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.535818 27636 raft_consensus.cc:348] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.536258 27636 raft_consensus.cc:374] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:53.536394 27636 raft_consensus.cc:729] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3766ef82ca30420ca014698c3fb51cf7, State: Initialized, Role: FOLLOWER
I20260809 22:49:53.537256 27636 consensus_queue.cc:260] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.538501 27389 heartbeater.cc:503] Master 127.23.131.126:40301 was elected leader, sending a full tablet report...
I20260809 22:49:53.538882 27646 raft_consensus.cc:482] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:53.539295 27636 ts_tablet_manager.cc:1428] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260809 22:49:53.539280 27646 raft_consensus.cc:504] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.541581 27637 ts_tablet_manager.cc:1428] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Time spent starting tablet: real 0.018s user 0.015s sys 0.001s
I20260809 22:49:53.542656 27646 leader_election.cc:288] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509), 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867)
I20260809 22:49:53.551733 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.541637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.23.131.67:43195)
0809 22:49:53.542025 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.542047 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.542172 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.543974 (+ 1802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.543982 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.544010 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.544218 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.544233 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.545945 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.545952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.548641 (+ 2689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.548660 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.550826 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.550832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.551084 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.551124 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.551262 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.551429 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260809 22:49:53.551761 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.542618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:43195 (local address 127.23.131.65:44509)
0809 22:49:53.543071 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.543080 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.543104 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:49:53.543167 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.543171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.543269 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.543364 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.544407 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.545770 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.549021 (+ 3251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.550473 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.550605 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.550687 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.551349 (+ 662us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.551505 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298}
I20260809 22:49:53.552779 27068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76f7e880c8d4f578369fe64e539f54a" candidate_uuid: "4b89006aec04481ea9204ed77396c017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63067f7fc8d741e29c48716b770f467a" is_pre_election: true
I20260809 22:49:53.553332 27068 raft_consensus.cc:2454] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b89006aec04481ea9204ed77396c017 in term 0.
I20260809 22:49:53.554083 27421 leader_election.cc:302] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b89006aec04481ea9204ed77396c017, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:53.554513 27646 raft_consensus.cc:2781] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:53.554677 27646 raft_consensus.cc:482] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:53.554807 27646 raft_consensus.cc:3037] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:53.557206 27646 raft_consensus.cc:504] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.557534 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.545563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:40517 (local address 127.23.131.66:43867)
0809 22:49:53.545990 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.545999 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.551541 (+ 5542us) server_negotiation.cc:407] Connection header received
0809 22:49:53.551684 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.551689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.551772 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.551870 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.552630 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.553709 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.555781 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.556571 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.556763 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.556838 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.557123 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.557270 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260809 22:49:53.557571 27654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.544656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:43867 (local address 127.23.131.67:40517)
0809 22:49:53.551404 (+ 6748us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.551438 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.551569 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.552064 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.552069 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.552095 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.552432 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.552442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.553884 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.553887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.555628 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.555641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.556791 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.556797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.556960 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.556983 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.557085 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.557219 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6597,"thread_start_us":6381,"threads_started":1}
I20260809 22:49:53.557963 27646 leader_election.cc:288] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [CANDIDATE]: Term 1 election: Requested vote from peers 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509), 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867)
I20260809 22:49:53.558519 27068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76f7e880c8d4f578369fe64e539f54a" candidate_uuid: "4b89006aec04481ea9204ed77396c017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63067f7fc8d741e29c48716b770f467a"
I20260809 22:49:53.558744 27068 raft_consensus.cc:3037] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:53.558643 27296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76f7e880c8d4f578369fe64e539f54a" candidate_uuid: "4b89006aec04481ea9204ed77396c017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7"
I20260809 22:49:53.558676 27300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76f7e880c8d4f578369fe64e539f54a" candidate_uuid: "4b89006aec04481ea9204ed77396c017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7" is_pre_election: true
I20260809 22:49:53.559183 27296 raft_consensus.cc:3037] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Advancing to term 1
W20260809 22:49:53.561480 27390 tablet.cc:2369] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:49:53.561842 27296 raft_consensus.cc:2454] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b89006aec04481ea9204ed77396c017 in term 1.
I20260809 22:49:53.561868 27068 raft_consensus.cc:2454] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b89006aec04481ea9204ed77396c017 in term 1.
I20260809 22:49:53.562244 27422 leader_election.cc:302] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 4b89006aec04481ea9204ed77396c017; no voters:
I20260809 22:49:53.562572 27646 raft_consensus.cc:2781] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:53.563015 27646 raft_consensus.cc:686] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 1 LEADER]: Becoming Leader. State: Replica: 4b89006aec04481ea9204ed77396c017, State: Running, Role: LEADER
I20260809 22:49:53.563570 27646 consensus_queue.cc:237] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.568528 26822 catalog_manager.cc:5495] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b89006aec04481ea9204ed77396c017 (127.23.131.67). New cstate: current_term: 1 leader_uuid: "4b89006aec04481ea9204ed77396c017" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } health_report { overall_health: HEALTHY } } }
Aug 09 22:49:53 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315791, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:53.623698 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.609819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40301 (local address 127.0.0.1:34652)
0809 22:49:53.610543 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.610564 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.610716 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.611058 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.611061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.611829 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:49:53.612113 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.612122 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.613164 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.613168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.614202 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.614214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.614924 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.614929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.615051 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.615750 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:49:53.615767 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:49:53.618055 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:49:53.621101 (+ 3046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:53.621113 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:53.621119 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:53.621633 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:53.622016 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:49:53.622021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:49:53.622025 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:49:53.622163 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:49:53.622687 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:49:53.622693 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:49:53.622857 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.622997 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.623349 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":421,"threads_started":1}
I20260809 22:49:53.623747 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.609791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.23.131.126:40301)
0809 22:49:53.610036 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.610041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.610671 (+ 630us) server_negotiation.cc:407] Connection header received
0809 22:49:53.610822 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.610826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.610899 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.610992 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:53.612258 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.613014 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.614334 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.614748 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.614847 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.618239 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:53.618244 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:53.618247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:53.618277 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:53.620958 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.621766 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.621771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.621773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.621891 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:53.622271 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:53.622274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:53.622276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:53.622558 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:53.622706 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.623102 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.623502 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":175,"server-negotiator.queue_time_us":81}
I20260809 22:49:53.629508 26822 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:34652:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 22:49:53.630683 26822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 22:49:53.634930 27607 tablet.cc:2369] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:49:53.637795 27041 tablet_service.cc:1467] Processing CreateTablet for tablet 6a271e987aaf4a238bd3531cdb35ee84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=afa477ebb2ad4c238188fa436f671ac9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:49:53.637959 27262 tablet_service.cc:1467] Processing CreateTablet for tablet 6a271e987aaf4a238bd3531cdb35ee84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=afa477ebb2ad4c238188fa436f671ac9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:49:53.638886 27041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a271e987aaf4a238bd3531cdb35ee84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:53.638908 27262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a271e987aaf4a238bd3531cdb35ee84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:53.638839 27499 tablet_service.cc:1467] Processing CreateTablet for tablet 6a271e987aaf4a238bd3531cdb35ee84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=afa477ebb2ad4c238188fa436f671ac9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:49:53.639775 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a271e987aaf4a238bd3531cdb35ee84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:53.645418 27637 tablet_bootstrap.cc:492] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: Bootstrap starting.
I20260809 22:49:53.646461 27636 tablet_bootstrap.cc:492] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: Bootstrap starting.
I20260809 22:49:53.647406 27634 tablet_bootstrap.cc:492] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: Bootstrap starting.
I20260809 22:49:53.648180 27637 tablet_bootstrap.cc:654] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:53.648306 27636 tablet_bootstrap.cc:654] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:53.648996 27634 tablet_bootstrap.cc:654] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:53.650884 27636 tablet_bootstrap.cc:492] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: No bootstrap required, opened a new log
I20260809 22:49:53.651060 27636 ts_tablet_manager.cc:1397] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 22:49:53.651326 27634 tablet_bootstrap.cc:492] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: No bootstrap required, opened a new log
I20260809 22:49:53.651326 27637 tablet_bootstrap.cc:492] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: No bootstrap required, opened a new log
I20260809 22:49:53.651470 27637 ts_tablet_manager.cc:1397] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 22:49:53.651489 27634 ts_tablet_manager.cc:1397] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20260809 22:49:53.651938 27636 raft_consensus.cc:348] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.652215 27636 raft_consensus.cc:374] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:53.652320 27636 raft_consensus.cc:729] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3766ef82ca30420ca014698c3fb51cf7, State: Initialized, Role: FOLLOWER
I20260809 22:49:53.652287 27637 raft_consensus.cc:348] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.652542 27637 raft_consensus.cc:374] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:53.652657 27637 raft_consensus.cc:729] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Initialized, Role: FOLLOWER
I20260809 22:49:53.652556 27636 consensus_queue.cc:260] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.652587 27634 raft_consensus.cc:348] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.652891 27637 consensus_queue.cc:260] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.653218 27636 ts_tablet_manager.cc:1428] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 22:49:53.653582 27637 ts_tablet_manager.cc:1428] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 22:49:53.653448 27647 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:53.653872 27647 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:53.653079 27634 raft_consensus.cc:374] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:53.654075 27634 raft_consensus.cc:729] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b89006aec04481ea9204ed77396c017, State: Initialized, Role: FOLLOWER
I20260809 22:49:53.654162 27652 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:53.654326 27634 consensus_queue.cc:260] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.654520 27652 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:53.654960 27634 ts_tablet_manager.cc:1428] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260809 22:49:53.655748 27646 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:53.656045 27646 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 22:49:53.767066 27155 tablet.cc:2369] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:49:53.880932 27647 raft_consensus.cc:482] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:53.881177 27647 raft_consensus.cc:504] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.882737 27647 leader_election.cc:288] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:53.890223 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.883376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:57503 (local address 127.23.131.66:43867)
0809 22:49:53.883604 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.883610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.883957 (+ 347us) server_negotiation.cc:407] Connection header received
0809 22:49:53.884253 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.884259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.884342 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.884413 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.885242 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.886365 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.888325 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.889180 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.889360 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.889442 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.889756 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.889912 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 22:49:53.890239 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.883107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:43867 (local address 127.23.131.65:57503)
0809 22:49:53.883831 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.883853 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.884032 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.884664 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.884668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.884701 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.885095 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.885105 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.886516 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.886520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.888158 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.888171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.889416 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.889422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.889592 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.889620 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.889726 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.889858 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":384,"threads_started":1}
I20260809 22:49:53.890308 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.884337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58063 (local address 127.23.131.67:46119)
0809 22:49:53.884551 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.884557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.884940 (+ 383us) server_negotiation.cc:407] Connection header received
0809 22:49:53.885166 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.885172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.885250 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.885347 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:53.885815 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.886764 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.888520 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.889313 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.889511 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.889587 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.889856 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.889984 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 22:49:53.890563 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.883953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46119 (local address 127.23.131.65:58063)
0809 22:49:53.884832 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.884846 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.885013 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.885365 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.885368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.885387 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:53.885665 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.885672 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.886920 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.886925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.888356 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.888368 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.889541 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.889548 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.889703 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.889726 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.889829 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.889948 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":614,"threads_started":1}
I20260809 22:49:53.891191 27296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a271e987aaf4a238bd3531cdb35ee84" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7" is_pre_election: true
I20260809 22:49:53.891414 27535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a271e987aaf4a238bd3531cdb35ee84" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017" is_pre_election: true
I20260809 22:49:53.891610 27296 raft_consensus.cc:2454] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 0.
I20260809 22:49:53.891813 27535 raft_consensus.cc:2454] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 0.
I20260809 22:49:53.892171 26962 leader_election.cc:302] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:53.892588 27647 raft_consensus.cc:2781] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:53.892736 27647 raft_consensus.cc:482] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:53.892841 27647 raft_consensus.cc:3037] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:53.895144 27647 raft_consensus.cc:504] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.895793 27647 leader_election.cc:288] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 election: Requested vote from peers 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:53.896342 27296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a271e987aaf4a238bd3531cdb35ee84" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7"
I20260809 22:49:53.896404 27535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a271e987aaf4a238bd3531cdb35ee84" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017"
I20260809 22:49:53.896587 27535 raft_consensus.cc:3037] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:53.896610 27296 raft_consensus.cc:3037] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:53.899672 27296 raft_consensus.cc:2454] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 1.
I20260809 22:49:53.899686 27535 raft_consensus.cc:2454] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 1.
I20260809 22:49:53.900043 26962 leader_election.cc:302] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:53.900362 27647 raft_consensus.cc:2781] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:53.900844 27647 raft_consensus.cc:686] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [term 1 LEADER]: Becoming Leader. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Running, Role: LEADER
I20260809 22:49:53.901324 27647 consensus_queue.cc:237] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:53.904695 27681 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: TxnStatusTablet state changed. Reason: New leader 63067f7fc8d741e29c48716b770f467a. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:53.905140 27681 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:49:53.905874 27687 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 22:49:53.906159 27687 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 22:49:53.906179 26821 catalog_manager.cc:5495] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a reported cstate change: term changed from 0 to 1, leader changed from <none> to 63067f7fc8d741e29c48716b770f467a (127.23.131.65). New cstate: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } health_report { overall_health: UNKNOWN } } }
I20260809 22:49:53.958760 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.951811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.0.0.1:41062)
0809 22:49:53.952081 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:53.952126 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:53.952267 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:53.953073 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:53.953079 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:53.953096 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:53.953314 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.953324 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.954849 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.954853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.955956 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:53.955969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.957011 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.957016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:53.957192 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.957251 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:53.958303 (+ 1052us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:53.958325 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 22:49:53.958399 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 22:49:53.958520 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 22:49:53.958889 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:53.951828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41062 (local address 127.23.131.65:44509)
0809 22:49:53.952597 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:53.952603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:53.952641 (+ 38us) server_negotiation.cc:407] Connection header received
0809 22:49:53.952740 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:53.952747 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:53.952853 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:53.953013 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:53.953462 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.954715 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.956118 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:53.956822 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:53.956959 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:53.957448 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:53.958186 (+ 738us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:53.958330 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:53.958448 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 22:49:53.958546 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631}
I20260809 22:49:53.961634 27646 consensus_queue.cc:1035] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:53.972064 27656 consensus_queue.cc:1035] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:53.979879 27535 raft_consensus.cc:1261] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Refusing update from remote peer 63067f7fc8d741e29c48716b770f467a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:53.981846 27681 consensus_queue.cc:1035] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:53.983780 27296 raft_consensus.cc:1261] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Refusing update from remote peer 63067f7fc8d741e29c48716b770f467a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:53.984426 27647 consensus_queue.cc:1035] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:53.991663 27656 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: TxnStatusTablet state changed. Reason: New leader 63067f7fc8d741e29c48716b770f467a. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:53.991992 27656 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:53.992799 27652 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: TxnStatusTablet state changed. Reason: New leader 63067f7fc8d741e29c48716b770f467a. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:53.993121 27652 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:54.003890 27652 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:54.004293 27652 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 3766ef82ca30420ca014698c3fb51cf7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:54.008852 27704 mvcc.cc:205] Tried to move back new op lower bound from 7316749492131303424 to 7316749491823403008. Current Snapshot: MvccSnapshot[applied={T|T < 7316749492131303424 or (T in {7316749492131303424})}]
I20260809 22:49:54.009825 27647 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:54.010138 27647 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:49:54.010206 27656 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:54.010510 27656 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 4b89006aec04481ea9204ed77396c017: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:49:54.010558 27647 tablet_replica.cc:439] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } } }
I20260809 22:49:54.010775 27647 tablet_replica.cc:442] T 6a271e987aaf4a238bd3531cdb35ee84 P 63067f7fc8d741e29c48716b770f467a: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:49:54.025957 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.019073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58972 (local address 127.23.131.67:46119)
0809 22:49:54.019305 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:54.019313 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:54.019862 (+ 549us) server_negotiation.cc:407] Connection header received
0809 22:49:54.020174 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:54.020181 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:54.020285 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:54.020445 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:54.020866 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.021997 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.023452 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.024119 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.024249 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.024626 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.025345 (+ 719us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.025490 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:54.025541 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 22:49:54.025630 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 22:49:54.043514 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.037488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:42625 (local address 127.23.131.65:44509)
0809 22:49:54.037727 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:54.037735 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:54.038145 (+ 410us) server_negotiation.cc:407] Connection header received
0809 22:49:54.038383 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:54.038394 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:54.038473 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:54.038572 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:54.039083 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.039925 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.041550 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.042033 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.042196 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.042640 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.042761 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.042861 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:54.043029 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 22:49:54.043115 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:49:54.043582 27720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.037380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.23.131.67:42625)
0809 22:49:54.038035 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:54.038051 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:54.038230 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:54.038593 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:54.038597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:54.038609 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:54.038904 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:54.038912 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.040118 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.040123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:54.041369 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:54.041382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.042233 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.042240 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:54.042369 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.042431 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.042865 (+ 434us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.042879 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 22:49:54.042998 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 22:49:54.043153 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":356,"threads_started":1}
I20260809 22:49:54.088579 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.082244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:56919 (local address 127.23.131.67:46119)
0809 22:49:54.082430 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:54.082437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:54.082580 (+ 143us) server_negotiation.cc:407] Connection header received
0809 22:49:54.082819 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:54.082828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:54.082890 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:54.082984 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:54.083692 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.084515 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.086538 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.087005 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.087174 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.087671 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.087773 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.087873 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:54.088036 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 22:49:54.088309 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 22:49:54.088615 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.081705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46119 (local address 127.23.131.65:56919)
0809 22:49:54.082465 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:54.082488 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:54.082676 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:54.083002 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:54.083006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:54.083018 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:54.083526 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:54.083538 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.084658 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.084664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:54.086390 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:54.086404 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.087265 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.087273 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:54.087424 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.087480 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.087874 (+ 394us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.087888 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 22:49:54.087976 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 22:49:54.088123 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":395,"threads_started":1}
I20260809 22:49:54.127466 26822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:54.127815 26822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:54.132687 26822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Sending DeleteTablet for 3 replicas of tablet a76f7e880c8d4f578369fe64e539f54a
I20260809 22:49:54.134132 27041 tablet_service.cc:1514] Processing DeleteTablet for tablet a76f7e880c8d4f578369fe64e539f54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:54 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:41046
I20260809 22:49:54.135725 27262 tablet_service.cc:1514] Processing DeleteTablet for tablet a76f7e880c8d4f578369fe64e539f54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:54 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:44498
I20260809 22:49:54.136497 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet a76f7e880c8d4f578369fe64e539f54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:54 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58956
I20260809 22:49:54.144351 27730 tablet_replica.cc:330] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: stopping tablet replica
I20260809 22:49:54.144969 27730 raft_consensus.cc:2229] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:54.145486 27730 raft_consensus.cc:2258] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:54.147804 27730 ts_tablet_manager.cc:1905] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:54.148108 26822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:54.151466 26822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:54.157068 27730 ts_tablet_manager.cc:1918] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:54.157341 27730 log.cc:1196] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/a76f7e880c8d4f578369fe64e539f54a
I20260809 22:49:54.157985 27730 ts_tablet_manager.cc:1939] T a76f7e880c8d4f578369fe64e539f54a P 63067f7fc8d741e29c48716b770f467a: Deleting consensus metadata
I20260809 22:49:54.159927 26801 catalog_manager.cc:4841] TS 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509): tablet a76f7e880c8d4f578369fe64e539f54a (table test-table [id=a0a9ca7d5d32485291e2a19b6434001b]) successfully deleted
I20260809 22:49:54.160743 27732 tablet_replica.cc:330] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: stopping tablet replica
I20260809 22:49:54.161664 27731 tablet_replica.cc:330] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: stopping tablet replica
I20260809 22:49:54.161880 27732 raft_consensus.cc:2229] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:49:54.162560 27732 raft_consensus.cc:2258] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:54.163074 27731 raft_consensus.cc:2229] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:54.163748 27731 raft_consensus.cc:2258] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:54.165725 27041 tablet_service.cc:1467] Processing CreateTablet for tablet 751585b94817401d88fa6347240da8f2 (DEFAULT_TABLE table=test-table [id=22e925f8762c4e7daa980a7918338a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:54.165827 27731 ts_tablet_manager.cc:1905] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:54.166258 27041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 751585b94817401d88fa6347240da8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:54.172679 27498 tablet_service.cc:1467] Processing CreateTablet for tablet 751585b94817401d88fa6347240da8f2 (DEFAULT_TABLE table=test-table [id=22e925f8762c4e7daa980a7918338a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:54.172857 27261 tablet_service.cc:1467] Processing CreateTablet for tablet 751585b94817401d88fa6347240da8f2 (DEFAULT_TABLE table=test-table [id=22e925f8762c4e7daa980a7918338a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:54.173234 27498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 751585b94817401d88fa6347240da8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:54.173311 27261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 751585b94817401d88fa6347240da8f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:54.179548 27732 ts_tablet_manager.cc:1905] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:54.179749 27736 tablet_bootstrap.cc:492] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Bootstrap starting.
I20260809 22:49:54.181211 27731 ts_tablet_manager.cc:1918] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:54.181798 27736 tablet_bootstrap.cc:654] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:54.181834 27731 log.cc:1196] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/a76f7e880c8d4f578369fe64e539f54a
I20260809 22:49:54.182680 27731 ts_tablet_manager.cc:1939] T a76f7e880c8d4f578369fe64e539f54a P 3766ef82ca30420ca014698c3fb51cf7: Deleting consensus metadata
I20260809 22:49:54.185177 26802 catalog_manager.cc:4841] TS 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867): tablet a76f7e880c8d4f578369fe64e539f54a (table test-table [id=a0a9ca7d5d32485291e2a19b6434001b]) successfully deleted
I20260809 22:49:54.190708 27737 tablet_bootstrap.cc:492] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Bootstrap starting.
I20260809 22:49:54.191721 27738 tablet_bootstrap.cc:492] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Bootstrap starting.
I20260809 22:49:54.193145 27737 tablet_bootstrap.cc:654] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:54.193186 27732 ts_tablet_manager.cc:1918] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:54.193483 27732 log.cc:1196] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/a76f7e880c8d4f578369fe64e539f54a
I20260809 22:49:54.193925 27738 tablet_bootstrap.cc:654] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:54.194242 27732 ts_tablet_manager.cc:1939] T a76f7e880c8d4f578369fe64e539f54a P 4b89006aec04481ea9204ed77396c017: Deleting consensus metadata
I20260809 22:49:54.194373 27736 tablet_bootstrap.cc:492] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: No bootstrap required, opened a new log
I20260809 22:49:54.194558 27736 ts_tablet_manager.cc:1397] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260809 22:49:54.195454 27736 raft_consensus.cc:348] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.195737 27736 raft_consensus.cc:374] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:54.195858 27736 raft_consensus.cc:729] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Initialized, Role: FOLLOWER
I20260809 22:49:54.196112 26802 catalog_manager.cc:4841] TS 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119): tablet a76f7e880c8d4f578369fe64e539f54a (table test-table [id=a0a9ca7d5d32485291e2a19b6434001b]) successfully deleted
I20260809 22:49:54.196199 27736 consensus_queue.cc:260] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.198005 27736 ts_tablet_manager.cc:1428] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 22:49:54.202896 27737 tablet_bootstrap.cc:492] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: No bootstrap required, opened a new log
I20260809 22:49:54.203138 27737 ts_tablet_manager.cc:1397] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260809 22:49:54.204048 27737 raft_consensus.cc:348] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.204213 27738 tablet_bootstrap.cc:492] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: No bootstrap required, opened a new log
I20260809 22:49:54.204368 27737 raft_consensus.cc:374] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:54.204382 27738 ts_tablet_manager.cc:1397] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260809 22:49:54.204515 27737 raft_consensus.cc:729] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3766ef82ca30420ca014698c3fb51cf7, State: Initialized, Role: FOLLOWER
I20260809 22:49:54.204841 27737 consensus_queue.cc:260] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.205206 27738 raft_consensus.cc:348] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.205489 27738 raft_consensus.cc:374] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:54.205606 27738 raft_consensus.cc:729] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b89006aec04481ea9204ed77396c017, State: Initialized, Role: FOLLOWER
I20260809 22:49:54.205907 27738 consensus_queue.cc:260] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.206557 27738 ts_tablet_manager.cc:1428] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 22:49:54.208169 27737 ts_tablet_manager.cc:1428] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260809 22:49:54.277597 27681 raft_consensus.cc:482] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:54.277858 27681 raft_consensus.cc:504] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.278649 27681 leader_election.cc:288] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:54.280131 27296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751585b94817401d88fa6347240da8f2" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7" is_pre_election: true
I20260809 22:49:54.280455 27296 raft_consensus.cc:2454] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 0.
I20260809 22:49:54.280993 27535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751585b94817401d88fa6347240da8f2" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017" is_pre_election: true
I20260809 22:49:54.281267 27535 raft_consensus.cc:2454] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 0.
I20260809 22:49:54.282081 26962 leader_election.cc:302] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:54.282723 27681 raft_consensus.cc:2781] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:54.282838 27681 raft_consensus.cc:482] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:54.282980 27681 raft_consensus.cc:3037] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:54.286599 27681 raft_consensus.cc:504] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.289393 27296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751585b94817401d88fa6347240da8f2" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7"
I20260809 22:49:54.289669 27296 raft_consensus.cc:3037] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:54.293226 27296 raft_consensus.cc:2454] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 1.
I20260809 22:49:54.293787 26962 leader_election.cc:302] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:54.294190 27647 raft_consensus.cc:2781] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:54.294350 27647 raft_consensus.cc:686] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 1 LEADER]: Becoming Leader. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Running, Role: LEADER
I20260809 22:49:54.294659 27647 consensus_queue.cc:237] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:54.298305 27535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751585b94817401d88fa6347240da8f2" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017"
I20260809 22:49:54.298555 27535 raft_consensus.cc:3037] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:54.301908 27535 raft_consensus.cc:2454] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 1.
I20260809 22:49:54.302862 27681 leader_election.cc:288] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 election: Requested vote from peers 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:54.305166 26822 catalog_manager.cc:5495] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a reported cstate change: term changed from 0 to 1, leader changed from <none> to 63067f7fc8d741e29c48716b770f467a (127.23.131.65). New cstate: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } health_report { overall_health: UNKNOWN } } }
I20260809 22:49:54.335876 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.328630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54540 (local address 127.23.131.65:44509)
0809 22:49:54.329176 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:54.329185 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:54.329210 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:49:54.329283 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:54.329288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:54.329379 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:54.329490 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:54.330096 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.331324 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.333405 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.334220 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.334355 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.334938 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.335127 (+ 189us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.335242 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:54.335460 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 22:49:54.335551 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365}
I20260809 22:49:54.355801 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.348478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.23.131.65:60895)
0809 22:49:54.348716 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:54.348738 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:54.348861 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:54.349784 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:54.349789 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:54.349805 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:54.350002 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:54.350017 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.351563 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.351568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:54.353301 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:54.353317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.354421 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.354427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:54.354647 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.354697 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.355175 (+ 478us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.355184 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 22:49:54.355280 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 22:49:54.355439 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 22:49:54.356412 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:54.349080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:60895 (local address 127.23.131.65:44509)
0809 22:49:54.349284 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:54.349290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:54.349308 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:49:54.349384 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:54.349389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:54.349471 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:54.349574 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:54.350167 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.351397 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.353475 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:54.354175 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:54.354307 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:54.354856 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:54.355028 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:54.355114 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:54.356042 (+ 928us) server_negotiation.cc:299] Negotiation successful
0809 22:49:54.356143 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 22:49:54.367766 27535 raft_consensus.cc:1261] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Refusing update from remote peer 63067f7fc8d741e29c48716b770f467a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:54.368376 27647 consensus_queue.cc:1035] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:54.368595 27296 raft_consensus.cc:1261] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Refusing update from remote peer 63067f7fc8d741e29c48716b770f467a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:54.369484 27681 consensus_queue.cc:1035] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:54.389108 27691 mvcc.cc:205] Tried to move back new op lower bound from 7316749493724438528 to 7316749493435846656. Current Snapshot: MvccSnapshot[applied={T|T < 7316749493724438528}]
I20260809 22:49:54.391999 27698 mvcc.cc:205] Tried to move back new op lower bound from 7316749493724438528 to 7316749493435846656. Current Snapshot: MvccSnapshot[applied={T|T < 7316749493724438528}]
W20260809 22:49:54.434119 27691 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 22:49:56.063668 26822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:56.063899 26822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:56.068302 26822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Sending DeleteTablet for 3 replicas of tablet 751585b94817401d88fa6347240da8f2
I20260809 22:49:56.069231 27040 tablet_service.cc:1514] Processing DeleteTablet for tablet 751585b94817401d88fa6347240da8f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:56 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:41046
I20260809 22:49:56.069262 27261 tablet_service.cc:1514] Processing DeleteTablet for tablet 751585b94817401d88fa6347240da8f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:56 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:44498
I20260809 22:49:56.069376 27498 tablet_service.cc:1514] Processing DeleteTablet for tablet 751585b94817401d88fa6347240da8f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:56 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58956
I20260809 22:49:56.083995 27794 tablet_replica.cc:330] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: stopping tablet replica
I20260809 22:49:56.084295 27791 tablet_replica.cc:330] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: stopping tablet replica
I20260809 22:49:56.084487 27794 raft_consensus.cc:2229] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:56.084611 27791 raft_consensus.cc:2229] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:49:56.084882 27794 raft_consensus.cc:2258] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:56.085333 27791 raft_consensus.cc:2258] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:56.085916 27789 tablet_replica.cc:330] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: stopping tablet replica
I20260809 22:49:56.086241 27789 raft_consensus.cc:2229] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:56.086437 27794 ts_tablet_manager.cc:1905] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:56.086572 27791 ts_tablet_manager.cc:1905] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:56.086647 27789 raft_consensus.cc:2258] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:56.087764 27789 ts_tablet_manager.cc:1905] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:56.093997 27794 ts_tablet_manager.cc:1918] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 22:49:56.094203 27791 ts_tablet_manager.cc:1918] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 22:49:56.094246 27794 log.cc:1196] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/751585b94817401d88fa6347240da8f2
I20260809 22:49:56.094444 27791 log.cc:1196] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/751585b94817401d88fa6347240da8f2
I20260809 22:49:56.094729 27794 ts_tablet_manager.cc:1939] T 751585b94817401d88fa6347240da8f2 P 4b89006aec04481ea9204ed77396c017: Deleting consensus metadata
I20260809 22:49:56.094765 27789 ts_tablet_manager.cc:1918] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 22:49:56.094950 27789 log.cc:1196] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/751585b94817401d88fa6347240da8f2
I20260809 22:49:56.095082 27791 ts_tablet_manager.cc:1939] T 751585b94817401d88fa6347240da8f2 P 63067f7fc8d741e29c48716b770f467a: Deleting consensus metadata
I20260809 22:49:56.095526 27789 ts_tablet_manager.cc:1939] T 751585b94817401d88fa6347240da8f2 P 3766ef82ca30420ca014698c3fb51cf7: Deleting consensus metadata
I20260809 22:49:56.096242 26802 catalog_manager.cc:4841] TS 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119): tablet 751585b94817401d88fa6347240da8f2 (table test-table [id=22e925f8762c4e7daa980a7918338a4c]) successfully deleted
I20260809 22:49:56.096386 26801 catalog_manager.cc:4841] TS 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509): tablet 751585b94817401d88fa6347240da8f2 (table test-table [id=22e925f8762c4e7daa980a7918338a4c]) successfully deleted
I20260809 22:49:56.096760 26802 catalog_manager.cc:4841] TS 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867): tablet 751585b94817401d88fa6347240da8f2 (table test-table [id=22e925f8762c4e7daa980a7918338a4c]) successfully deleted
Aug 09 22:49:56 dist-test-slave-92m1 krb5kdc[26756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315796, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 22:49:56 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315796, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:49:56.145215 27808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.129991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42076 (local address 127.23.131.126:40301)
0809 22:49:56.130776 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.130781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.130809 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:49:56.130984 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.130988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.131065 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.131164 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:56.132701 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.133526 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.134733 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.135161 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.135338 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.139402 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:56.139407 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:56.139410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:56.139448 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:56.142447 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:56.143233 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:56.143240 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:56.143247 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:56.143397 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:56.143793 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:56.143797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:56.143798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:56.144079 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:56.144281 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.144663 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.144837 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":356,"threads_started":1}
I20260809 22:49:56.148917 26822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:56.149498 26822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:56.156713 27040 tablet_service.cc:1467] Processing CreateTablet for tablet 7ecef05bf61842378a31ea11bb8ced31 (DEFAULT_TABLE table=test-table [id=95203a1f9b814b4ebd8d66fb8a02ad11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:56.156894 27261 tablet_service.cc:1467] Processing CreateTablet for tablet 7ecef05bf61842378a31ea11bb8ced31 (DEFAULT_TABLE table=test-table [id=95203a1f9b814b4ebd8d66fb8a02ad11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:56.157279 27040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ecef05bf61842378a31ea11bb8ced31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:56.157323 27261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ecef05bf61842378a31ea11bb8ced31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:56.157289 27498 tablet_service.cc:1467] Processing CreateTablet for tablet 7ecef05bf61842378a31ea11bb8ced31 (DEFAULT_TABLE table=test-table [id=95203a1f9b814b4ebd8d66fb8a02ad11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:56.157740 27498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ecef05bf61842378a31ea11bb8ced31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:56.163435 27809 tablet_bootstrap.cc:492] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Bootstrap starting.
I20260809 22:49:56.164384 27811 tablet_bootstrap.cc:492] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Bootstrap starting.
I20260809 22:49:56.165251 27815 tablet_bootstrap.cc:492] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Bootstrap starting.
I20260809 22:49:56.165647 27809 tablet_bootstrap.cc:654] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:56.166314 27811 tablet_bootstrap.cc:654] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:56.167148 27815 tablet_bootstrap.cc:654] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:56.168212 27809 tablet_bootstrap.cc:492] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: No bootstrap required, opened a new log
I20260809 22:49:56.168375 27809 ts_tablet_manager.cc:1397] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 22:49:56.169122 27809 raft_consensus.cc:348] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.169436 27811 tablet_bootstrap.cc:492] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: No bootstrap required, opened a new log
I20260809 22:49:56.169451 27815 tablet_bootstrap.cc:492] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: No bootstrap required, opened a new log
I20260809 22:49:56.169456 27809 raft_consensus.cc:374] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:56.169557 27809 raft_consensus.cc:729] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b89006aec04481ea9204ed77396c017, State: Initialized, Role: FOLLOWER
I20260809 22:49:56.169579 27811 ts_tablet_manager.cc:1397] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 22:49:56.169615 27815 ts_tablet_manager.cc:1397] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260809 22:49:56.169809 27809 consensus_queue.cc:260] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.170785 27811 raft_consensus.cc:348] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.171051 27811 raft_consensus.cc:374] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:56.171159 27811 raft_consensus.cc:729] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Initialized, Role: FOLLOWER
I20260809 22:49:56.171433 27811 consensus_queue.cc:260] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.171929 27815 raft_consensus.cc:348] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.172231 27811 ts_tablet_manager.cc:1428] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 22:49:56.172325 27815 raft_consensus.cc:374] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:56.172511 27815 raft_consensus.cc:729] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3766ef82ca30420ca014698c3fb51cf7, State: Initialized, Role: FOLLOWER
I20260809 22:49:56.172863 27815 consensus_queue.cc:260] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.173938 27815 ts_tablet_manager.cc:1428] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260809 22:49:56.183774 27809 ts_tablet_manager.cc:1428] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Time spent starting tablet: real 0.015s user 0.005s sys 0.009s
I20260809 22:49:56.273505 27822 raft_consensus.cc:482] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:56.273875 27822 raft_consensus.cc:504] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.275681 27822 leader_election.cc:288] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:56.285044 27827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.276667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46119 (local address 127.23.131.66:45701)
0809 22:49:56.277647 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:56.277668 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:56.277816 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:56.278294 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:56.278298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:56.278321 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:56.278789 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.278800 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.280334 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.280339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.282293 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.282308 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.284117 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.284124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.284328 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.284368 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:49:56.284463 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 22:49:56.284618 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"mutex_wait_us":5,"thread_start_us":617,"threads_started":1}
I20260809 22:49:56.285071 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.276262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:45701 (local address 127.23.131.67:46119)
0809 22:49:56.277062 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.277072 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.277779 (+ 707us) server_negotiation.cc:407] Connection header received
0809 22:49:56.277967 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.277972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.278043 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.278138 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:56.278974 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.280144 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.282500 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.283897 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.284129 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.284237 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.284515 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.284675 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":694,"threads_started":1}
I20260809 22:49:56.285776 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.276088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:46429 (local address 127.23.131.65:44509)
0809 22:49:56.276924 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.276931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.277517 (+ 586us) server_negotiation.cc:407] Connection header received
0809 22:49:56.277743 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.277750 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.277844 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.277977 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:49:56.278660 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.279929 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.282611 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.284104 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.284300 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.284411 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.285136 (+ 725us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.285305 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":385,"threads_started":1}
I20260809 22:49:56.286098 27830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.276075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.23.131.66:46429)
0809 22:49:56.277372 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:56.277400 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:56.277564 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:56.278001 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:56.278006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:56.278042 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:49:56.278427 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.278447 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.280097 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.280102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.282443 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.282459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.284438 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.284449 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.284663 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.284699 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 22:49:56.284825 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 22:49:56.284991 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1155,"mutex_wait_us":3,"thread_start_us":1000,"threads_started":1}
I20260809 22:49:56.286158 27532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecef05bf61842378a31ea11bb8ced31" candidate_uuid: "3766ef82ca30420ca014698c3fb51cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017" is_pre_election: true
I20260809 22:49:56.286476 27532 raft_consensus.cc:2454] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3766ef82ca30420ca014698c3fb51cf7 in term 0.
I20260809 22:49:56.286895 27068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecef05bf61842378a31ea11bb8ced31" candidate_uuid: "3766ef82ca30420ca014698c3fb51cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63067f7fc8d741e29c48716b770f467a" is_pre_election: true
I20260809 22:49:56.287047 27189 leader_election.cc:302] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 4b89006aec04481ea9204ed77396c017; no voters:
I20260809 22:49:56.287240 27068 raft_consensus.cc:2454] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3766ef82ca30420ca014698c3fb51cf7 in term 0.
I20260809 22:49:56.287552 27822 raft_consensus.cc:2781] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:56.287709 27822 raft_consensus.cc:482] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:56.287822 27822 raft_consensus.cc:3037] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:56.290124 27822 raft_consensus.cc:504] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.290911 27822 leader_election.cc:288] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:56.291436 27068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecef05bf61842378a31ea11bb8ced31" candidate_uuid: "3766ef82ca30420ca014698c3fb51cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63067f7fc8d741e29c48716b770f467a"
I20260809 22:49:56.291503 27532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecef05bf61842378a31ea11bb8ced31" candidate_uuid: "3766ef82ca30420ca014698c3fb51cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017"
I20260809 22:49:56.291698 27532 raft_consensus.cc:3037] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:56.291716 27068 raft_consensus.cc:3037] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:56.294813 27532 raft_consensus.cc:2454] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3766ef82ca30420ca014698c3fb51cf7 in term 1.
I20260809 22:49:56.294795 27068 raft_consensus.cc:2454] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3766ef82ca30420ca014698c3fb51cf7 in term 1.
I20260809 22:49:56.295262 27189 leader_election.cc:302] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 4b89006aec04481ea9204ed77396c017; no voters:
I20260809 22:49:56.295646 27822 raft_consensus.cc:2781] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:56.296135 27822 raft_consensus.cc:686] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 LEADER]: Becoming Leader. State: Replica: 3766ef82ca30420ca014698c3fb51cf7, State: Running, Role: LEADER
I20260809 22:49:56.296527 27822 consensus_queue.cc:237] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.299723 26822 catalog_manager.cc:5495] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66). New cstate: current_term: 1 leader_uuid: "3766ef82ca30420ca014698c3fb51cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } health_report { overall_health: UNKNOWN } } }
I20260809 22:49:56.331548 27838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.324398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36288 (local address 127.23.131.66:43867)
0809 22:49:56.325381 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.325385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.325411 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:49:56.325494 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.325497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.325574 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.325749 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:56.326188 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.327357 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.328864 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.329541 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.329642 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.330146 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:56.330798 (+ 652us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:56.330912 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.330982 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.331054 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":858,"thread_start_us":1300,"threads_started":1}
I20260809 22:49:56.346876 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.341550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:33565 (local address 127.23.131.65:44509)
0809 22:49:56.341729 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.341733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.342312 (+ 579us) server_negotiation.cc:407] Connection header received
0809 22:49:56.342479 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.342482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.342549 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.342623 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:56.343135 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.343993 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.345394 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.345814 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.345944 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.346335 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:56.346433 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:56.346499 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.346624 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.346685 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 22:49:56.347105 27845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.341438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44509 (local address 127.23.131.66:33565)
0809 22:49:56.342227 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:56.342243 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:56.342361 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:56.342654 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:56.342658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:56.342667 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:56.342998 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.343006 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.344124 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.344128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.345277 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.345289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.345983 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.345988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.346124 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.346172 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:56.346517 (+ 345us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:56.346526 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 22:49:56.346591 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 22:49:56.346698 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":399,"threads_started":1}
I20260809 22:49:56.355787 27532 raft_consensus.cc:1261] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Refusing update from remote peer 3766ef82ca30420ca014698c3fb51cf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:56.356053 27068 raft_consensus.cc:1261] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Refusing update from remote peer 3766ef82ca30420ca014698c3fb51cf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:56.356441 27831 consensus_queue.cc:1035] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:56.356838 27822 consensus_queue.cc:1035] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:56.383529 27838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.377425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:57245 (local address 127.23.131.66:43867)
0809 22:49:56.377613 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.377622 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.378157 (+ 535us) server_negotiation.cc:407] Connection header received
0809 22:49:56.378357 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.378362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.378441 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.378532 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:56.379061 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.379883 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.381601 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.382150 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.382249 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.382743 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:56.382870 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:56.382953 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.383168 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.383289 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 22:49:56.383653 27852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.377343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:43867 (local address 127.23.131.65:57245)
0809 22:49:56.378052 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0809 22:49:56.378074 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:49:56.378228 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:49:56.378549 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:49:56.378554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:49:56.378565 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:49:56.378891 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.378907 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.380012 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.380018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.381385 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:49:56.381400 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.382325 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.382332 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:49:56.382503 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.382552 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:49:56.383034 (+ 482us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:49:56.383044 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 22:49:56.383116 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 22:49:56.383283 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":365,"threads_started":1}
I20260809 22:49:56.418274 26822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:56.418525 26822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:56.421798 26822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Sending DeleteTablet for 3 replicas of tablet 7ecef05bf61842378a31ea11bb8ced31
I20260809 22:49:56.422633 27261 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ecef05bf61842378a31ea11bb8ced31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:56 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:44498
I20260809 22:49:56.422788 27498 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ecef05bf61842378a31ea11bb8ced31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:56 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58956
I20260809 22:49:56.422931 27789 tablet_replica.cc:330] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: stopping tablet replica
I20260809 22:49:56.423086 27794 tablet_replica.cc:330] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: stopping tablet replica
I20260809 22:49:56.423329 27794 raft_consensus.cc:2229] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:56.423146 27789 raft_consensus.cc:2229] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:49:56.423561 27794 raft_consensus.cc:2258] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:56.423856 27789 raft_consensus.cc:2258] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:56.423974 27040 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ecef05bf61842378a31ea11bb8ced31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:56 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:41046
I20260809 22:49:56.423820 26822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:49:56.424501 26822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:49:56.424535 27791 tablet_replica.cc:330] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: stopping tablet replica
I20260809 22:49:56.424747 27791 raft_consensus.cc:2229] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:56.424949 27791 raft_consensus.cc:2258] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:56.425331 27789 ts_tablet_manager.cc:1905] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:56.426461 27794 ts_tablet_manager.cc:1905] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:56.427174 27791 ts_tablet_manager.cc:1905] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:56.433620 27794 ts_tablet_manager.cc:1918] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:56.433864 27794 log.cc:1196] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/7ecef05bf61842378a31ea11bb8ced31
I20260809 22:49:56.434043 27791 ts_tablet_manager.cc:1918] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:56.434320 27791 log.cc:1196] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/7ecef05bf61842378a31ea11bb8ced31
I20260809 22:49:56.434297 27789 ts_tablet_manager.cc:1918] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:49:56.434489 27789 log.cc:1196] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/7ecef05bf61842378a31ea11bb8ced31
I20260809 22:49:56.434551 27794 ts_tablet_manager.cc:1939] T 7ecef05bf61842378a31ea11bb8ced31 P 4b89006aec04481ea9204ed77396c017: Deleting consensus metadata
I20260809 22:49:56.434826 27791 ts_tablet_manager.cc:1939] T 7ecef05bf61842378a31ea11bb8ced31 P 63067f7fc8d741e29c48716b770f467a: Deleting consensus metadata
I20260809 22:49:56.436129 26801 catalog_manager.cc:4841] TS 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509): tablet 7ecef05bf61842378a31ea11bb8ced31 (table test-table [id=95203a1f9b814b4ebd8d66fb8a02ad11]) successfully deleted
I20260809 22:49:56.437237 26802 catalog_manager.cc:4841] TS 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119): tablet 7ecef05bf61842378a31ea11bb8ced31 (table test-table [id=95203a1f9b814b4ebd8d66fb8a02ad11]) successfully deleted
I20260809 22:49:56.439730 27789 ts_tablet_manager.cc:1939] T 7ecef05bf61842378a31ea11bb8ced31 P 3766ef82ca30420ca014698c3fb51cf7: Deleting consensus metadata
I20260809 22:49:56.439858 27261 tablet_service.cc:1467] Processing CreateTablet for tablet b941638a516e4cabacafa967d78f6522 (DEFAULT_TABLE table=test-table [id=0ee89b9207d2473eb04e257f24241648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:56.440322 27261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b941638a516e4cabacafa967d78f6522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:56.441005 26802 catalog_manager.cc:4841] TS 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867): tablet 7ecef05bf61842378a31ea11bb8ced31 (table test-table [id=95203a1f9b814b4ebd8d66fb8a02ad11]) successfully deleted
I20260809 22:49:56.441445 27498 tablet_service.cc:1467] Processing CreateTablet for tablet b941638a516e4cabacafa967d78f6522 (DEFAULT_TABLE table=test-table [id=0ee89b9207d2473eb04e257f24241648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:56.441852 27498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b941638a516e4cabacafa967d78f6522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:56.443735 27040 tablet_service.cc:1467] Processing CreateTablet for tablet b941638a516e4cabacafa967d78f6522 (DEFAULT_TABLE table=test-table [id=0ee89b9207d2473eb04e257f24241648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:49:56.444680 27040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b941638a516e4cabacafa967d78f6522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:49:56.447419 27815 tablet_bootstrap.cc:492] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Bootstrap starting.
I20260809 22:49:56.448401 27809 tablet_bootstrap.cc:492] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Bootstrap starting.
I20260809 22:49:56.449344 27815 tablet_bootstrap.cc:654] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:56.450106 27809 tablet_bootstrap.cc:654] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:56.455286 27811 tablet_bootstrap.cc:492] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Bootstrap starting.
I20260809 22:49:56.457023 27811 tablet_bootstrap.cc:654] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Neither blocks nor log segments found. Creating new log.
I20260809 22:49:56.459715 27815 tablet_bootstrap.cc:492] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: No bootstrap required, opened a new log
I20260809 22:49:56.459977 27815 ts_tablet_manager.cc:1397] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260809 22:49:56.460565 27809 tablet_bootstrap.cc:492] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: No bootstrap required, opened a new log
I20260809 22:49:56.460808 27809 ts_tablet_manager.cc:1397] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.010s
I20260809 22:49:56.460922 27815 raft_consensus.cc:348] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.461313 27815 raft_consensus.cc:374] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:56.461712 27809 raft_consensus.cc:348] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.461975 27809 raft_consensus.cc:374] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:56.461862 27815 raft_consensus.cc:729] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3766ef82ca30420ca014698c3fb51cf7, State: Initialized, Role: FOLLOWER
I20260809 22:49:56.462061 27809 raft_consensus.cc:729] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b89006aec04481ea9204ed77396c017, State: Initialized, Role: FOLLOWER
I20260809 22:49:56.462483 27815 consensus_queue.cc:260] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.462375 27809 consensus_queue.cc:260] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.463914 27815 ts_tablet_manager.cc:1428] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 22:49:56.466732 27809 ts_tablet_manager.cc:1428] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260809 22:49:56.468863 27811 tablet_bootstrap.cc:492] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: No bootstrap required, opened a new log
I20260809 22:49:56.469053 27811 ts_tablet_manager.cc:1397] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.003s
I20260809 22:49:56.469877 27811 raft_consensus.cc:348] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.470284 27811 raft_consensus.cc:374] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:49:56.470377 27811 raft_consensus.cc:729] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Initialized, Role: FOLLOWER
I20260809 22:49:56.470642 27811 consensus_queue.cc:260] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.471263 27811 ts_tablet_manager.cc:1428] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 22:49:56.597558 27767 raft_consensus.cc:482] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:49:56.597846 27767 raft_consensus.cc:504] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.598712 27767 leader_election.cc:288] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:56.599574 27300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b941638a516e4cabacafa967d78f6522" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7" is_pre_election: true
I20260809 22:49:56.599635 27532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b941638a516e4cabacafa967d78f6522" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017" is_pre_election: true
I20260809 22:49:56.599887 27532 raft_consensus.cc:2454] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 0.
I20260809 22:49:56.599896 27300 raft_consensus.cc:2454] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 0.
I20260809 22:49:56.600427 26962 leader_election.cc:302] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3766ef82ca30420ca014698c3fb51cf7, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:56.600739 27767 raft_consensus.cc:2781] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:49:56.600867 27767 raft_consensus.cc:482] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:49:56.600965 27767 raft_consensus.cc:3037] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:56.603077 27767 raft_consensus.cc:504] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.603777 27767 leader_election.cc:288] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 election: Requested vote from peers 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867), 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119)
I20260809 22:49:56.604357 27532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b941638a516e4cabacafa967d78f6522" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b89006aec04481ea9204ed77396c017"
I20260809 22:49:56.604403 27300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b941638a516e4cabacafa967d78f6522" candidate_uuid: "63067f7fc8d741e29c48716b770f467a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3766ef82ca30420ca014698c3fb51cf7"
I20260809 22:49:56.604598 27532 raft_consensus.cc:3037] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:56.604660 27300 raft_consensus.cc:3037] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:49:56.607784 27532 raft_consensus.cc:2454] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 1.
I20260809 22:49:56.608033 27300 raft_consensus.cc:2454] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63067f7fc8d741e29c48716b770f467a in term 1.
I20260809 22:49:56.608325 26962 leader_election.cc:302] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b89006aec04481ea9204ed77396c017, 63067f7fc8d741e29c48716b770f467a; no voters:
I20260809 22:49:56.608770 27767 raft_consensus.cc:2781] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:49:56.608958 27767 raft_consensus.cc:686] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 1 LEADER]: Becoming Leader. State: Replica: 63067f7fc8d741e29c48716b770f467a, State: Running, Role: LEADER
I20260809 22:49:56.609273 27767 consensus_queue.cc:237] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } }
I20260809 22:49:56.612303 26820 catalog_manager.cc:5495] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a reported cstate change: term changed from 0 to 1, leader changed from <none> to 63067f7fc8d741e29c48716b770f467a (127.23.131.65). New cstate: current_term: 1 leader_uuid: "63067f7fc8d741e29c48716b770f467a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63067f7fc8d741e29c48716b770f467a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 } health_report { overall_health: UNKNOWN } } }
I20260809 22:49:56.656092 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:56.650567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54552 (local address 127.23.131.65:44509)
0809 22:49:56.650752 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:56.650760 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:56.650905 (+ 145us) server_negotiation.cc:407] Connection header received
0809 22:49:56.651076 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:56.651082 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:56.651187 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:56.651311 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:49:56.651637 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.652792 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.654087 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:56.654769 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:56.654911 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:56.655331 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:49:56.655492 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:49:56.655587 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:56.655720 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 22:49:56.655799 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:49:56.665112 27532 raft_consensus.cc:1261] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Refusing update from remote peer 63067f7fc8d741e29c48716b770f467a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:56.665840 27781 consensus_queue.cc:1035] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b89006aec04481ea9204ed77396c017" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:49:56.666056 27300 raft_consensus.cc:1261] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Refusing update from remote peer 63067f7fc8d741e29c48716b770f467a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:49:56.666713 27767 consensus_queue.cc:1035] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3766ef82ca30420ca014698c3fb51cf7" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 22:49:56.690574 27755 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 22:49:58.282829 26822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:58.283116 26822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:49:58.287364 26822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c1f16482993346df9601c6ee4f8aad0c: Sending DeleteTablet for 3 replicas of tablet b941638a516e4cabacafa967d78f6522
I20260809 22:49:58.288270 27040 tablet_service.cc:1514] Processing DeleteTablet for tablet b941638a516e4cabacafa967d78f6522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:58 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:41046
I20260809 22:49:58.288301 27261 tablet_service.cc:1514] Processing DeleteTablet for tablet b941638a516e4cabacafa967d78f6522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:58 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:44498
I20260809 22:49:58.288384 27498 tablet_service.cc:1514] Processing DeleteTablet for tablet b941638a516e4cabacafa967d78f6522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:49:58 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58956
I20260809 22:49:58.289132 27902 tablet_replica.cc:330] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: stopping tablet replica
I20260809 22:49:58.289453 27906 tablet_replica.cc:330] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: stopping tablet replica
I20260809 22:49:58.289426 27902 raft_consensus.cc:2229] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:49:58.289734 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26928
I20260809 22:49:58.290095 27902 raft_consensus.cc:2258] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:58.290139 27906 raft_consensus.cc:2229] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:58.290714 27906 raft_consensus.cc:2258] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:58.291339 27902 ts_tablet_manager.cc:1905] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:58.292117 27906 ts_tablet_manager.cc:1905] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:58.295441 27905 tablet_replica.cc:330] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: stopping tablet replica
I20260809 22:49:58.295800 27905 raft_consensus.cc:2229] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:49:58.296293 27905 raft_consensus.cc:2258] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:49:58.297793 27905 ts_tablet_manager.cc:1905] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:49:58.298943 27906 ts_tablet_manager.cc:1918] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 22:49:58.298935 27902 ts_tablet_manager.cc:1918] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 22:49:58.299088 27902 log.cc:1196] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/b941638a516e4cabacafa967d78f6522
I20260809 22:49:58.299157 27906 log.cc:1196] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/b941638a516e4cabacafa967d78f6522
I20260809 22:49:58.299690 27902 ts_tablet_manager.cc:1939] T b941638a516e4cabacafa967d78f6522 P 63067f7fc8d741e29c48716b770f467a: Deleting consensus metadata
I20260809 22:49:58.299736 27906 ts_tablet_manager.cc:1939] T b941638a516e4cabacafa967d78f6522 P 4b89006aec04481ea9204ed77396c017: Deleting consensus metadata
I20260809 22:49:58.300887 26801 catalog_manager.cc:4841] TS 63067f7fc8d741e29c48716b770f467a (127.23.131.65:44509): tablet b941638a516e4cabacafa967d78f6522 (table test-table [id=0ee89b9207d2473eb04e257f24241648]) successfully deleted
I20260809 22:49:58.300943 26802 catalog_manager.cc:4841] TS 4b89006aec04481ea9204ed77396c017 (127.23.131.67:46119): tablet b941638a516e4cabacafa967d78f6522 (table test-table [id=0ee89b9207d2473eb04e257f24241648]) successfully deleted
I20260809 22:49:58.304965 27905 ts_tablet_manager.cc:1918] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 22:49:58.305109 27905 log.cc:1196] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/b941638a516e4cabacafa967d78f6522
I20260809 22:49:58.305516 27905 ts_tablet_manager.cc:1939] T b941638a516e4cabacafa967d78f6522 P 3766ef82ca30420ca014698c3fb51cf7: Deleting consensus metadata
I20260809 22:49:58.306634 26802 catalog_manager.cc:4841] TS 3766ef82ca30420ca014698c3fb51cf7 (127.23.131.66:43867): tablet b941638a516e4cabacafa967d78f6522 (table test-table [id=0ee89b9207d2473eb04e257f24241648]) successfully deleted
Aug 09 22:49:58 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315796, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:49:58.321238 27907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:58.292579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54554 (local address 127.23.131.65:44509)
0809 22:49:58.293208 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:58.293218 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:58.301625 (+ 8407us) server_negotiation.cc:407] Connection header received
0809 22:49:58.301767 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:58.301772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:58.301857 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:58.301986 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:58.303258 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:58.304402 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:58.305803 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:58.306424 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:58.306585 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:58.315465 (+ 8880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:58.315484 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:58.315500 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:58.315545 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:58.318394 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:58.319061 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:58.319068 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:58.319070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:58.319189 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:58.319576 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:58.319580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:58.319582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:58.320043 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:58.320387 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:58.320610 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 22:49:58.320846 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":245,"threads_started":1}
W20260809 22:49:58.321957 27144 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54554
W20260809 22:49:58.322603 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26928: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:49:58.322818 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26928
I20260809 22:49:58.370479 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27160
Aug 09 22:49:58 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315796, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:49:58.386101 27909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:58.371353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36292 (local address 127.23.131.66:43867)
0809 22:49:58.371892 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:58.371897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:58.371913 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:49:58.371971 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:58.371974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:58.372046 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:58.372141 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:58.373498 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:58.374254 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:58.375593 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:58.375990 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:58.376093 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:58.380298 (+ 4205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:58.380314 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:58.380330 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:58.380368 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:58.383393 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:58.384160 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:58.384168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:58.384170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:58.384299 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:58.384669 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:58.384672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:58.384674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:58.385019 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:58.385251 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:58.385582 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 22:49:58.385756 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":270,"threads_started":1}
W20260809 22:49:58.386768 27375 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36292
W20260809 22:49:58.387486 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27160: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:49:58.387651 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27160
I20260809 22:49:58.421062 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27395
Aug 09 22:49:58 dist-test-slave-92m1 krb5kdc[26756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315796, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:49:58.436669 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:49:58.421864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.23.131.67:46119)
0809 22:49:58.422481 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0809 22:49:58.422485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:49:58.422502 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:49:58.422561 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:49:58.422565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:49:58.422624 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:49:58.422720 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:49:58.424108 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:58.424897 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:58.426031 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:49:58.426405 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:49:58.426495 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:49:58.430872 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:49:58.430889 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:49:58.430907 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:49:58.430946 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:49:58.434011 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:58.434614 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:58.434621 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:58.434623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:58.434763 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:49:58.435119 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:49:58.435122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:49:58.435124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:49:58.435574 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:49:58.435802 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 22:49:58.436028 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 22:49:58.436257 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":342,"threads_started":1}
W20260809 22:49:58.437323 27601 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44356
W20260809 22:49:58.437901 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27395: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:49:58.438103 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27395
I20260809 22:49:58.475564 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26775
I20260809 22:49:58.476861 26877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:49:58.600610 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26775
2026-08-09T22:49:58Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9064 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:49:58 dist-test-slave-92m1 krb5kdc[27920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:49:58 dist-test-slave-92m1 krb5kdc[27920](info): set up 2 sockets
Aug 09 22:49:58 dist-test-slave-92m1 krb5kdc[27920](info): commencing operation
krb5kdc: starting...
W20260809 22:49:59.935477 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:00 dist-test-slave-92m1 krb5kdc[27920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:00.194759 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:34175
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:34175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:00.540288 27936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:00.540652 27936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:00.540758 27936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:00.548151 27936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:00.548270 27936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:00.548326 27936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:00.548385 27936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:00.548429 27936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:00.558466 27936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:34175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:34175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:00.559826 27936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:00.561126 27936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:00.573412 27943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:00.573444 27945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:00.573479 27947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:00.574373 27936 server_base.cc:1034] running on GCE node
I20260809 22:50:00.575291 27936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:00.576983 27936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:00.578258 27936 hybrid_clock.cc:648] HybridClock initialized: now 1786315800578199 us; error 52 us; skew 500 ppm
I20260809 22:50:00.578670 27936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:00 dist-test-slave-92m1 krb5kdc[27920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315800, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:00.582099 27936 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:00.583983 27936 webserver.cc:460] Webserver started at http://127.23.131.126:44979/ using document root <none> and password file <none>
I20260809 22:50:00.584753 27936 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:00.584918 27936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:00.585280 27936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:00.588698 27936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "f5dafae3fd1d4eb691ddd4af809c8bef"
format_stamp: "Formatted at 2026-08-09 22:50:00 on dist-test-slave-92m1"
server_key: "ee26865b75c9c05d160f0c9ed5c7bf59"
server_key_iv: "73a42b06ec53fd5475e6787eaa22f37b"
server_key_version: "encryptionkey@0"
I20260809 22:50:00.589542 27936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "f5dafae3fd1d4eb691ddd4af809c8bef"
format_stamp: "Formatted at 2026-08-09 22:50:00 on dist-test-slave-92m1"
server_key: "ee26865b75c9c05d160f0c9ed5c7bf59"
server_key_iv: "73a42b06ec53fd5475e6787eaa22f37b"
server_key_version: "encryptionkey@0"
I20260809 22:50:00.595371 27936 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:50:00.599252 27958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:00.600696 27936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:00.600907 27936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "f5dafae3fd1d4eb691ddd4af809c8bef"
format_stamp: "Formatted at 2026-08-09 22:50:00 on dist-test-slave-92m1"
server_key: "ee26865b75c9c05d160f0c9ed5c7bf59"
server_key_iv: "73a42b06ec53fd5475e6787eaa22f37b"
server_key_version: "encryptionkey@0"
I20260809 22:50:00.601131 27936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:00.622732 27936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:00.626971 27936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:00.627336 27936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:00.647339 27936 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:34175
I20260809 22:50:00.647359 28050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:34175 every 8 connection(s)
I20260809 22:50:00.648813 27936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:00.649945 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27936
I20260809 22:50:00.650218 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:00.651057 24077 external_mini_cluster.cc:1428] Setting key c40cac715fe3ea773c2526b4ffed9573
I20260809 22:50:00.653821 28051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:50:00 dist-test-slave-92m1 krb5kdc[27920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:00.667647 28051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef: Bootstrap starting.
I20260809 22:50:00.671278 28051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:00.672348 28051 log.cc:824] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:00.675159 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:00.653293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.23.131.126:34175)
0809 22:50:00.654168 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:00.654180 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:00.654221 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:50:00.656149 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:00.656169 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:00.656549 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:00.656885 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:00.658804 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:00.660251 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:00.662071 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:00.662705 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:00.662837 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:00.667595 (+ 4758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:00.667603 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:00.667620 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:00.667661 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:00.670977 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:00.671825 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:00.671831 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:00.671837 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:00.672008 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:00.672387 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:00.672392 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:00.672395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:00.673126 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:00.673467 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:00.673814 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 22:50:00.674242 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":374,"threads_started":1}
I20260809 22:50:00.675567 28051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef: No bootstrap required, opened a new log
I20260809 22:50:00.684017 28051 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34175 } }
I20260809 22:50:00.684399 28051 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:00.684484 28051 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5dafae3fd1d4eb691ddd4af809c8bef, State: Initialized, Role: FOLLOWER
I20260809 22:50:00.685071 28051 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34175 } }
I20260809 22:50:00.685300 28051 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:00.685397 28051 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:00.685530 28051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:00.687896 28051 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34175 } }
I20260809 22:50:00.688500 28051 leader_election.cc:302] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5dafae3fd1d4eb691ddd4af809c8bef; no voters:
I20260809 22:50:00.689194 28051 leader_election.cc:288] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:00.689343 28056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:00.690037 28056 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [term 1 LEADER]: Becoming Leader. State: Replica: f5dafae3fd1d4eb691ddd4af809c8bef, State: Running, Role: LEADER
I20260809 22:50:00.690618 28056 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34175 } }
I20260809 22:50:00.691448 28051 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:00.693814 28058 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5dafae3fd1d4eb691ddd4af809c8bef. Latest consensus state: current_term: 1 leader_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34175 } } }
I20260809 22:50:00.693912 28057 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5dafae3fd1d4eb691ddd4af809c8bef" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34175 } } }
I20260809 22:50:00.694245 28058 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:00.694334 28057 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:00.697570 28066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:00.702210 28066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:00.711506 28066 catalog_manager.cc:1347] Generated new cluster ID: cb8aed6c10fa4fb7a6c074db5492e933
I20260809 22:50:00.711630 28066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:00.727298 28066 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:00.728601 28066 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:00.751261 28066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5dafae3fd1d4eb691ddd4af809c8bef: Generated new TSK 0
I20260809 22:50:00.752166 28066 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:50:00.815749 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34175
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:01.171558 28090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:01.171895 28090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:01.172065 28090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:01.179610 28090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:01.179778 28090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:01.179958 28090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:01.190016 28090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:01.191493 28090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:01.193033 28090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:01.206478 28097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:01.206796 28101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:01.206446 28099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:01.207377 28090 server_base.cc:1034] running on GCE node
I20260809 22:50:01.208001 28090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:01.208978 28090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:01.210203 28090 hybrid_clock.cc:648] HybridClock initialized: now 1786315801210141 us; error 57 us; skew 500 ppm
I20260809 22:50:01.210531 28090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:01 dist-test-slave-92m1 krb5kdc[27920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315801, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:01.213938 28090 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:50:01.215586 28090 webserver.cc:460] Webserver started at http://127.23.131.65:39767/ using document root <none> and password file <none>
I20260809 22:50:01.216349 28090 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:01.216495 28090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:01.216831 28090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:01.220448 28090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "80d617d159d8434b91644c9c1e1394fb"
format_stamp: "Formatted at 2026-08-09 22:50:01 on dist-test-slave-92m1"
server_key: "068af553857937ebe355b0784932f4f8"
server_key_iv: "9e6054892bc5f8b256393a422d399d12"
server_key_version: "encryptionkey@0"
I20260809 22:50:01.221340 28090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "80d617d159d8434b91644c9c1e1394fb"
format_stamp: "Formatted at 2026-08-09 22:50:01 on dist-test-slave-92m1"
server_key: "068af553857937ebe355b0784932f4f8"
server_key_iv: "9e6054892bc5f8b256393a422d399d12"
server_key_version: "encryptionkey@0"
I20260809 22:50:01.226806 28090 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 22:50:01.230585 28111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:01.232004 28090 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 22:50:01.232198 28090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "80d617d159d8434b91644c9c1e1394fb"
format_stamp: "Formatted at 2026-08-09 22:50:01 on dist-test-slave-92m1"
server_key: "068af553857937ebe355b0784932f4f8"
server_key_iv: "9e6054892bc5f8b256393a422d399d12"
server_key_version: "encryptionkey@0"
I20260809 22:50:01.232422 28090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:01.265033 28090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:01.269717 28090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:01.270040 28090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:01.271077 28090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:01.272526 28090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:01.272643 28090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:01.272789 28090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:01.272869 28090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:01.309139 28090 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:34271
I20260809 22:50:01.309185 28295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:34271 every 8 connection(s)
I20260809 22:50:01.310552 28090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:01.314181 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28090
I20260809 22:50:01.314424 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:01.315160 24077 external_mini_cluster.cc:1428] Setting key 2ca0df79af531dc1c97f9a526318ded2
Aug 09 22:50:01 dist-test-slave-92m1 krb5kdc[27920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315801, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:01.332578 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:01.313332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:43301 (local address 127.23.131.126:34175)
0809 22:50:01.313820 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:01.313826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:01.314888 (+ 1062us) server_negotiation.cc:407] Connection header received
0809 22:50:01.317019 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:01.317023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:01.317115 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:01.317225 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:01.318696 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.319977 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.321501 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.322189 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.322337 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:01.325864 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:01.325874 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:01.325881 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:01.325923 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:01.329034 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:01.330018 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:01.330022 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:01.330025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:01.330161 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:01.330709 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:01.330712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:01.330714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:01.331014 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:01.331133 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:01.332126 (+ 993us) server_negotiation.cc:299] Negotiation successful
0809 22:50:01.332315 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":232,"threads_started":1}
I20260809 22:50:01.334239 28302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:01.313885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:34175 (local address 127.23.131.65:43301)
0809 22:50:01.314721 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:01.314766 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:01.316735 (+ 1969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:01.317444 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:01.317453 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:01.317957 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:01.318510 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:01.318537 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.320134 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.320137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:01.321352 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:01.321364 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.322420 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.322424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:01.322639 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:01.323353 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:01.323377 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:01.325623 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:01.329180 (+ 3557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:01.329192 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:01.329213 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:01.329877 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:01.330300 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:01.330307 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:01.330314 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:01.330598 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:01.331157 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:01.331168 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:01.331719 (+ 551us) client_negotiation.cc:769] Sending connection context
0809 22:50:01.332040 (+ 321us) client_negotiation.cc:240] Negotiation successful
0809 22:50:01.332666 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":383,"threads_started":1}
I20260809 22:50:01.336057 28298 heartbeater.cc:347] Connected to a master server at 127.23.131.126:34175
I20260809 22:50:01.336434 28298 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:01.337324 28298 heartbeater.cc:511] Master 127.23.131.126:34175 requested a full tablet report, sending...
I20260809 22:50:01.339663 27993 ts_manager.cc:194] Registered new tserver with Master: 80d617d159d8434b91644c9c1e1394fb (127.23.131.65:34271)
I20260809 22:50:01.341128 27993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:43301
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:50:01.374914 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34175
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:01.732345 28306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:01.732687 28306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:01.732789 28306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:01.740309 28306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:01.740420 28306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:01.740542 28306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:01.750123 28306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:01.751348 28306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:01.752843 28306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:01.766073 28318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:01.766198 28316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:01.766376 28315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:01.767155 28306 server_base.cc:1034] running on GCE node
I20260809 22:50:01.767891 28306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:01.768893 28306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:01.770113 28306 hybrid_clock.cc:648] HybridClock initialized: now 1786315801770049 us; error 36 us; skew 500 ppm
I20260809 22:50:01.770442 28306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:01 dist-test-slave-92m1 krb5kdc[27920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315801, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:01.773728 28306 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:50:01.775404 28306 webserver.cc:460] Webserver started at http://127.23.131.66:36409/ using document root <none> and password file <none>
I20260809 22:50:01.776158 28306 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:01.776305 28306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:01.776633 28306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:01.779872 28306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "409af520131c4d3ea02902389282e7a2"
format_stamp: "Formatted at 2026-08-09 22:50:01 on dist-test-slave-92m1"
server_key: "9219f81e12021feb2a7b142fae30ac7d"
server_key_iv: "88f4d433c90001c87d5c8e4b52d8bd70"
server_key_version: "encryptionkey@0"
I20260809 22:50:01.780730 28306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "409af520131c4d3ea02902389282e7a2"
format_stamp: "Formatted at 2026-08-09 22:50:01 on dist-test-slave-92m1"
server_key: "9219f81e12021feb2a7b142fae30ac7d"
server_key_iv: "88f4d433c90001c87d5c8e4b52d8bd70"
server_key_version: "encryptionkey@0"
I20260809 22:50:01.786646 28306 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 22:50:01.790457 28328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:01.791898 28306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:01.792083 28306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "409af520131c4d3ea02902389282e7a2"
format_stamp: "Formatted at 2026-08-09 22:50:01 on dist-test-slave-92m1"
server_key: "9219f81e12021feb2a7b142fae30ac7d"
server_key_iv: "88f4d433c90001c87d5c8e4b52d8bd70"
server_key_version: "encryptionkey@0"
I20260809 22:50:01.792320 28306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:01.811322 28306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:01.815618 28306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:01.815876 28306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:01.816828 28306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:01.818233 28306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:01.818310 28306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:01.818398 28306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:01.818450 28306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:01.853833 28306 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:41469
I20260809 22:50:01.853897 28501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:41469 every 8 connection(s)
I20260809 22:50:01.855142 28306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:01.861196 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28306
I20260809 22:50:01.861414 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:01.862006 24077 external_mini_cluster.cc:1428] Setting key b833d234382835c100513e05841a8657
Aug 09 22:50:01 dist-test-slave-92m1 krb5kdc[27920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315801, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:01.878178 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:01.857699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:36761 (local address 127.23.131.126:34175)
0809 22:50:01.858244 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:01.858250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:01.859114 (+ 864us) server_negotiation.cc:407] Connection header received
0809 22:50:01.861150 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:01.861155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:01.861246 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:01.861375 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:01.863581 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.864522 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.867190 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.867976 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.868130 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:01.872137 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:01.872143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:01.872146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:01.872180 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:01.874806 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:01.875669 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:01.875674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:01.875677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:01.875816 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:01.876287 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:01.876291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:01.876292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:01.876558 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:01.876728 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:01.877505 (+ 777us) server_negotiation.cc:299] Negotiation successful
0809 22:50:01.877765 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":269,"threads_started":1}
I20260809 22:50:01.879149 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:01.858246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:34175 (local address 127.23.131.66:36761)
0809 22:50:01.858941 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:01.858991 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:01.860874 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:01.861746 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:01.861757 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:01.862570 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:01.863409 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:01.863432 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.864699 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.864706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:01.866990 (+ 2284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:01.867012 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:01.868309 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:01.868337 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:01.868626 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:01.869346 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:01.869375 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:01.871891 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:01.874957 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:01.874966 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:01.874984 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:01.875524 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:01.875940 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:01.875944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:01.875947 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:01.876164 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:01.876699 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:01.876707 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:01.877122 (+ 415us) client_negotiation.cc:769] Sending connection context
0809 22:50:01.877403 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 22:50:01.877988 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":277,"threads_started":1}
I20260809 22:50:01.880743 28502 heartbeater.cc:347] Connected to a master server at 127.23.131.126:34175
I20260809 22:50:01.881134 28502 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:01.882143 28502 heartbeater.cc:511] Master 127.23.131.126:34175 requested a full tablet report, sending...
I20260809 22:50:01.883842 27993 ts_manager.cc:194] Registered new tserver with Master: 409af520131c4d3ea02902389282e7a2 (127.23.131.66:41469)
I20260809 22:50:01.884671 27993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:36761
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:50:01.923166 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34175
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:02.269797 28517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:02.270108 28517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:02.270210 28517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:02.277832 28517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:02.277956 28517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:02.278117 28517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:02.288280 28517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:02.289665 28517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:02.291050 28517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:02.304875 28523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:02.304917 28524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:02.304965 28526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:02.306401 28517 server_base.cc:1034] running on GCE node
I20260809 22:50:02.307025 28517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:02.308028 28517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:02.309263 28517 hybrid_clock.cc:648] HybridClock initialized: now 1786315802309212 us; error 36 us; skew 500 ppm
I20260809 22:50:02.309672 28517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:02 dist-test-slave-92m1 krb5kdc[27920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:02.313783 28517 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:50:02.315985 28517 webserver.cc:460] Webserver started at http://127.23.131.67:35353/ using document root <none> and password file <none>
I20260809 22:50:02.316944 28517 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:02.317123 28517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:02.317456 28517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:02.320619 28517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "39cb71c1f4eb4a34bc891a74a1a9bcd9"
format_stamp: "Formatted at 2026-08-09 22:50:02 on dist-test-slave-92m1"
server_key: "fa96c860466da898ea52ceee489ed508"
server_key_iv: "67afa5fb4f5220b05ceb7d161455e639"
server_key_version: "encryptionkey@0"
I20260809 22:50:02.321450 28517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "39cb71c1f4eb4a34bc891a74a1a9bcd9"
format_stamp: "Formatted at 2026-08-09 22:50:02 on dist-test-slave-92m1"
server_key: "fa96c860466da898ea52ceee489ed508"
server_key_iv: "67afa5fb4f5220b05ceb7d161455e639"
server_key_version: "encryptionkey@0"
I20260809 22:50:02.326843 28517 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:02.330585 28541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:02.331974 28517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:02.332170 28517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "39cb71c1f4eb4a34bc891a74a1a9bcd9"
format_stamp: "Formatted at 2026-08-09 22:50:02 on dist-test-slave-92m1"
server_key: "fa96c860466da898ea52ceee489ed508"
server_key_iv: "67afa5fb4f5220b05ceb7d161455e639"
server_key_version: "encryptionkey@0"
I20260809 22:50:02.332435 28517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:02.344676 28298 heartbeater.cc:503] Master 127.23.131.126:34175 was elected leader, sending a full tablet report...
I20260809 22:50:02.356958 28517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:02.361151 28517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:02.361462 28517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:02.362525 28517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:02.364006 28517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:02.364130 28517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:02.364269 28517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:02.364341 28517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:02.399330 28517 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:37613
I20260809 22:50:02.399396 28727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:37613 every 8 connection(s)
I20260809 22:50:02.400657 28517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:02.409766 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28517
I20260809 22:50:02.409974 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:02.410427 24077 external_mini_cluster.cc:1428] Setting key d0bce24a6c4782b2c078e4c462b4ff22
Aug 09 22:50:02 dist-test-slave-92m1 krb5kdc[27920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315802, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:02.421397 28733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:02.403415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:53301 (local address 127.23.131.126:34175)
0809 22:50:02.403907 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:02.403912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:02.404760 (+ 848us) server_negotiation.cc:407] Connection header received
0809 22:50:02.406799 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:02.406805 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:02.406917 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:02.407035 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:02.408545 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:02.409328 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:02.411038 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:02.411649 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:02.411775 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:02.415672 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:02.415677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:02.415680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:02.415714 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:02.418496 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:02.419325 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:02.419330 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:02.419332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:02.419461 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:02.419842 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:02.419845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:02.419847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:02.420111 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:02.420231 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:02.420943 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 22:50:02.421121 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":244,"threads_started":1}
I20260809 22:50:02.422385 28735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:02.403853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:34175 (local address 127.23.131.67:53301)
0809 22:50:02.404582 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:02.404630 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:02.406520 (+ 1890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:02.407324 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:02.407332 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:02.407829 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:02.408355 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:02.408371 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:02.409483 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:02.409493 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:02.410889 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:02.410901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:02.411897 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:02.411903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:02.412109 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:02.412855 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:02.412878 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:02.415494 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:02.418637 (+ 3143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:02.418644 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:02.418656 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:02.419146 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:02.419557 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:02.419560 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:02.419563 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:02.419742 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:02.420237 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:02.420243 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:02.420559 (+ 316us) client_negotiation.cc:769] Sending connection context
0809 22:50:02.420783 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 22:50:02.421197 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":283,"threads_started":1}
I20260809 22:50:02.423897 28730 heartbeater.cc:347] Connected to a master server at 127.23.131.126:34175
I20260809 22:50:02.424247 28730 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:02.425057 28730 heartbeater.cc:511] Master 127.23.131.126:34175 requested a full tablet report, sending...
I20260809 22:50:02.426599 27993 ts_manager.cc:194] Registered new tserver with Master: 39cb71c1f4eb4a34bc891a74a1a9bcd9 (127.23.131.67:37613)
I20260809 22:50:02.427472 27993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:53301
I20260809 22:50:02.438541 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 22:50:02.484268 28733 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:02.481467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.23.131.126:34175)
0809 22:50:02.481682 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:02.481687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:02.482190 (+ 503us) server_negotiation.cc:407] Connection header received
0809 22:50:02.482410 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:02.482415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:02.482503 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:02.482614 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:02.484063 (+ 1449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53330: BlockingRecv error: recv got EOF from 127.0.0.1:53330 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:50:02.487646 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28090
W20260809 22:50:02.490695 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28090: Not authorized: Client connection negotiation failed: client connection to 127.23.131.65:34271: server requires authentication, but client does not have Kerberos credentials available
I20260809 22:50:02.490859 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28090
I20260809 22:50:02.517109 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28306
W20260809 22:50:02.520030 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28306: Not authorized: Client connection negotiation failed: client connection to 127.23.131.66:41469: server requires authentication, but client does not have Kerberos credentials available
I20260809 22:50:02.520234 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28306
I20260809 22:50:02.546587 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28517
W20260809 22:50:02.549867 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28517: Not authorized: Client connection negotiation failed: client connection to 127.23.131.67:37613: server requires authentication, but client does not have Kerberos credentials available
I20260809 22:50:02.550026 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28517
I20260809 22:50:02.576120 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27936
I20260809 22:50:02.577368 28039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:02.685357 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27936
2026-08-09T22:50:02Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4085 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:02 dist-test-slave-92m1 krb5kdc[28763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:02 dist-test-slave-92m1 krb5kdc[28763](info): set up 2 sockets
Aug 09 22:50:02 dist-test-slave-92m1 krb5kdc[28763](info): commencing operation
krb5kdc: starting...
W20260809 22:50:04.032917 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.002s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:04 dist-test-slave-92m1 krb5kdc[28763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:04.288317 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41221
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:37725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:04.640842 28782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:04.641201 28782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:04.641371 28782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:04.648867 28782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:04.649034 28782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:04.649144 28782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:04.649241 28782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:04.649328 28782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:04.659464 28782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:37725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:04.660883 28782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:04.662220 28782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:04.674216 28789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:04.674343 28787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:04.674245 28791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:04.675155 28782 server_base.cc:1034] running on GCE node
I20260809 22:50:04.676008 28782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:04.677415 28782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:04.678617 28782 hybrid_clock.cc:648] HybridClock initialized: now 1786315804678577 us; error 30 us; skew 500 ppm
I20260809 22:50:04.678930 28782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:04 dist-test-slave-92m1 krb5kdc[28763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315804, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:04.686825 28782 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:04.688611 28782 webserver.cc:460] Webserver started at http://127.23.131.126:41287/ using document root <none> and password file <none>
I20260809 22:50:04.689270 28782 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:04.689373 28782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:04.689646 28782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:04.692751 28782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "8c4bfb15e1f64f0abc1083203e93f782"
format_stamp: "Formatted at 2026-08-09 22:50:04 on dist-test-slave-92m1"
server_key: "85cf48aa9f203d41074a33a3ff2f88df"
server_key_iv: "8a83c862254987a999d6140810ca76f3"
server_key_version: "encryptionkey@0"
I20260809 22:50:04.693527 28782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "8c4bfb15e1f64f0abc1083203e93f782"
format_stamp: "Formatted at 2026-08-09 22:50:04 on dist-test-slave-92m1"
server_key: "85cf48aa9f203d41074a33a3ff2f88df"
server_key_iv: "8a83c862254987a999d6140810ca76f3"
server_key_version: "encryptionkey@0"
I20260809 22:50:04.699537 28782 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 22:50:04.704787 28802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:04.706521 28782 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 22:50:04.706735 28782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "8c4bfb15e1f64f0abc1083203e93f782"
format_stamp: "Formatted at 2026-08-09 22:50:04 on dist-test-slave-92m1"
server_key: "85cf48aa9f203d41074a33a3ff2f88df"
server_key_iv: "8a83c862254987a999d6140810ca76f3"
server_key_version: "encryptionkey@0"
I20260809 22:50:04.707065 28782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:04.729146 28782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:04.737555 28782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:04.737963 28782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:04.762305 28877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41221 every 8 connection(s)
I20260809 22:50:04.762347 28782 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41221
I20260809 22:50:04.764753 28782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:04.766228 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28782
I20260809 22:50:04.766517 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:04.767437 24077 external_mini_cluster.cc:1428] Setting key afe56280b50a176b2d601989d505a2f5
I20260809 22:50:04.770539 28878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:04.787845 28878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782: Bootstrap starting.
Aug 09 22:50:04 dist-test-slave-92m1 krb5kdc[28763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:04.791515 28878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:04.792953 28878 log.cc:824] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:04.796450 28878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782: No bootstrap required, opened a new log
I20260809 22:50:04.800055 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:04.770327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47140 (local address 127.23.131.126:41221)
0809 22:50:04.776317 (+ 5990us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:04.776345 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:04.776428 (+ 83us) server_negotiation.cc:407] Connection header received
0809 22:50:04.779251 (+ 2823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:04.779289 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:04.779942 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:04.780524 (+ 582us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:04.782039 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:04.784133 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:04.785444 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:04.786577 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:04.786759 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:04.791141 (+ 4382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:04.791153 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:04.791173 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:04.791270 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:04.795273 (+ 4003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:04.795956 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:04.795964 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:04.795999 (+ 35us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:04.796222 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:04.796598 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:04.796603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:04.796606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:04.797409 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:04.797706 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:04.798102 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 22:50:04.798579 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5574,"thread_start_us":5257,"threads_started":1}
I20260809 22:50:04.804124 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:50:04.806355 28878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bfb15e1f64f0abc1083203e93f782" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41221 } }
I20260809 22:50:04.806761 28878 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:04.806883 28878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c4bfb15e1f64f0abc1083203e93f782, State: Initialized, Role: FOLLOWER
I20260809 22:50:04.807545 28878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bfb15e1f64f0abc1083203e93f782" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41221 } }
I20260809 22:50:04.807788 28878 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:04.807938 28878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:04.808104 28878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:04.810374 28878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bfb15e1f64f0abc1083203e93f782" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41221 } }
I20260809 22:50:04.810914 28878 leader_election.cc:302] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c4bfb15e1f64f0abc1083203e93f782; no voters:
I20260809 22:50:04.811602 28878 leader_election.cc:288] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:04.811758 28884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:04.813314 28884 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [term 1 LEADER]: Becoming Leader. State: Replica: 8c4bfb15e1f64f0abc1083203e93f782, State: Running, Role: LEADER
I20260809 22:50:04.813925 28884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bfb15e1f64f0abc1083203e93f782" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41221 } }
I20260809 22:50:04.814145 28878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:04.817946 28886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c4bfb15e1f64f0abc1083203e93f782. Latest consensus state: current_term: 1 leader_uuid: "8c4bfb15e1f64f0abc1083203e93f782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bfb15e1f64f0abc1083203e93f782" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41221 } } }
I20260809 22:50:04.818346 28886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:04.818866 28885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c4bfb15e1f64f0abc1083203e93f782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c4bfb15e1f64f0abc1083203e93f782" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41221 } } }
I20260809 22:50:04.819322 28885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:04.820645 28894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:04.827400 28894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:04.846148 28894 catalog_manager.cc:1347] Generated new cluster ID: dc46699849ee4bd18d5965a4b67baefb
I20260809 22:50:04.846400 28894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:04.887894 28918 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 22:50:04.898873 28894 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:04.900794 28894 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:04.902534 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:04.893090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.23.131.126:41221)
0809 22:50:04.893293 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:04.893300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:04.893935 (+ 635us) server_negotiation.cc:407] Connection header received
0809 22:50:04.894129 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:04.894139 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:04.894221 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:04.894329 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:04.895703 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:04.896696 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:04.898326 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:04.899014 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:04.899164 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:04.900532 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:04.900539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:04.900544 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:04.901489 (+ 945us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:04.901601 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:04.901643 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:04.901770 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:04.901976 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 22:50:04.902128 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":70}
I20260809 22:50:04.911722 28894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c4bfb15e1f64f0abc1083203e93f782: Generated new TSK 0
I20260809 22:50:04.912758 28894 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:50:04.921988 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28782
I20260809 22:50:04.923185 28872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:05.021167 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28782
2026-08-09T22:50:05Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2330 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:05 dist-test-slave-92m1 krb5kdc[28929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:05 dist-test-slave-92m1 krb5kdc[28929](info): set up 2 sockets
Aug 09 22:50:05 dist-test-slave-92m1 krb5kdc[28929](info): commencing operation
krb5kdc: starting...
W20260809 22:50:06.358436 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:06 dist-test-slave-92m1 krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:06.623373 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45153
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:06.982707 28947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:06.983068 28947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:06.983316 28947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:06.991122 28947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:06.991348 28947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:06.991464 28947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:06.991577 28947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:06.991654 28947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:07.002509 28947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:07.004067 28947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:07.005429 28947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:07.018618 28956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:07.018657 28954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:07.018671 28953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:07.019716 28947 server_base.cc:1034] running on GCE node
I20260809 22:50:07.020583 28947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:07.021997 28947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:07.023284 28947 hybrid_clock.cc:648] HybridClock initialized: now 1786315807023227 us; error 67 us; skew 500 ppm
I20260809 22:50:07.023653 28947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:07 dist-test-slave-92m1 krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315807, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:07.026952 28947 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:07.028764 28947 webserver.cc:460] Webserver started at http://127.23.131.126:38481/ using document root <none> and password file <none>
I20260809 22:50:07.029487 28947 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:07.029663 28947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:07.029981 28947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:07.033245 28947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "dcaecfc8e5be4c07a06459562bea2d29"
format_stamp: "Formatted at 2026-08-09 22:50:07 on dist-test-slave-92m1"
server_key: "df2ce1af19988c8efbcb4149d6e5f9b8"
server_key_iv: "d0e0be8db75646954457366061f191c8"
server_key_version: "encryptionkey@0"
I20260809 22:50:07.034085 28947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "dcaecfc8e5be4c07a06459562bea2d29"
format_stamp: "Formatted at 2026-08-09 22:50:07 on dist-test-slave-92m1"
server_key: "df2ce1af19988c8efbcb4149d6e5f9b8"
server_key_iv: "d0e0be8db75646954457366061f191c8"
server_key_version: "encryptionkey@0"
I20260809 22:50:07.039606 28947 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:50:07.043148 28964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:07.044598 28947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:07.044802 28947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "dcaecfc8e5be4c07a06459562bea2d29"
format_stamp: "Formatted at 2026-08-09 22:50:07 on dist-test-slave-92m1"
server_key: "df2ce1af19988c8efbcb4149d6e5f9b8"
server_key_iv: "d0e0be8db75646954457366061f191c8"
server_key_version: "encryptionkey@0"
I20260809 22:50:07.045027 28947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:07.065943 28947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:07.070653 28947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:07.070969 28947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:07.091698 28947 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:45153
I20260809 22:50:07.091738 29038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:45153 every 8 connection(s)
I20260809 22:50:07.093276 28947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:07.097386 29039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:07.100234 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28947
I20260809 22:50:07.100484 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:07.101182 24077 external_mini_cluster.cc:1428] Setting key f506cb8533b2a6a4d1e16b63fccfd392
I20260809 22:50:07.110472 29039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29: Bootstrap starting.
I20260809 22:50:07.114769 29039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:07.116312 29039 log.cc:824] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:50:07 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:07.119943 29039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29: No bootstrap required, opened a new log
I20260809 22:50:07.125734 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:07.103437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56572 (local address 127.23.131.126:45153)
0809 22:50:07.104260 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:07.104274 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:07.104318 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:50:07.106068 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:07.106092 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:07.106500 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:07.106833 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:07.108759 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:07.110103 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:07.111870 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:07.112593 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:07.112738 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:07.117818 (+ 5080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:07.117827 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:07.117843 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:07.117882 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:07.121269 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:07.122042 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:07.122049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:07.122055 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:07.122233 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:07.122666 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:07.122670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:07.122672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:07.123338 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:07.123683 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:07.124188 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 22:50:07.124662 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":373,"threads_started":1}
I20260809 22:50:07.128394 29039 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcaecfc8e5be4c07a06459562bea2d29" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45153 } }
I20260809 22:50:07.128849 29039 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:07.128965 29039 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcaecfc8e5be4c07a06459562bea2d29, State: Initialized, Role: FOLLOWER
I20260809 22:50:07.129453 29039 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcaecfc8e5be4c07a06459562bea2d29" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45153 } }
I20260809 22:50:07.129643 29039 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:07.129735 29039 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:07.129881 29039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:07.132511 29039 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcaecfc8e5be4c07a06459562bea2d29" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45153 } }
I20260809 22:50:07.132985 29039 leader_election.cc:302] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcaecfc8e5be4c07a06459562bea2d29; no voters:
I20260809 22:50:07.133504 29039 leader_election.cc:288] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:07.133665 29047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:07.134377 29047 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [term 1 LEADER]: Becoming Leader. State: Replica: dcaecfc8e5be4c07a06459562bea2d29, State: Running, Role: LEADER
I20260809 22:50:07.134894 29047 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcaecfc8e5be4c07a06459562bea2d29" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45153 } }
I20260809 22:50:07.135687 29039 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:07.138458 29050 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcaecfc8e5be4c07a06459562bea2d29. Latest consensus state: current_term: 1 leader_uuid: "dcaecfc8e5be4c07a06459562bea2d29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcaecfc8e5be4c07a06459562bea2d29" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45153 } } }
I20260809 22:50:07.138887 29050 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:07.139029 29049 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcaecfc8e5be4c07a06459562bea2d29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcaecfc8e5be4c07a06459562bea2d29" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45153 } } }
I20260809 22:50:07.139479 29049 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:07.141819 29056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:07.148691 29056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:07.157974 29056 catalog_manager.cc:1347] Generated new cluster ID: 94dee5c0099940a6b3c41c487f9a9ac7
I20260809 22:50:07.158090 29056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:07.193272 29056 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:07.194768 29056 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:07.205264 29056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcaecfc8e5be4c07a06459562bea2d29: Generated new TSK 0
I20260809 22:50:07.206151 29056 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:50:07.279496 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45153
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:07.650564 29084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:07.650934 29084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:07.651105 29084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:07.658589 29084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:07.658757 29084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:07.658946 29084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:07.668841 29084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:07.670271 29084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:07.671695 29084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:07.685544 29094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:07.685873 29093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:07.685824 29097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:07.686478 29084 server_base.cc:1034] running on GCE node
I20260809 22:50:07.687161 29084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:07.688215 29084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:07.689447 29084 hybrid_clock.cc:648] HybridClock initialized: now 1786315807689374 us; error 67 us; skew 500 ppm
I20260809 22:50:07.689782 29084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:07 dist-test-slave-92m1 krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315807, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:07.693172 29084 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:50:07.694702 29084 webserver.cc:460] Webserver started at http://127.23.131.65:34497/ using document root <none> and password file <none>
I20260809 22:50:07.695469 29084 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:07.695581 29084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:07.695842 29084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:07.698850 29084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "6663b9bfde4148d0a69f050c307ba620"
format_stamp: "Formatted at 2026-08-09 22:50:07 on dist-test-slave-92m1"
server_key: "191a68d1f5d83c1da2926c666c4e4a9e"
server_key_iv: "47e4e833db6bf6614819c2367d51bdac"
server_key_version: "encryptionkey@0"
I20260809 22:50:07.699704 29084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "6663b9bfde4148d0a69f050c307ba620"
format_stamp: "Formatted at 2026-08-09 22:50:07 on dist-test-slave-92m1"
server_key: "191a68d1f5d83c1da2926c666c4e4a9e"
server_key_iv: "47e4e833db6bf6614819c2367d51bdac"
server_key_version: "encryptionkey@0"
I20260809 22:50:07.705054 29084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 22:50:07.708786 29107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:07.710170 29084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:07.710340 29084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "6663b9bfde4148d0a69f050c307ba620"
format_stamp: "Formatted at 2026-08-09 22:50:07 on dist-test-slave-92m1"
server_key: "191a68d1f5d83c1da2926c666c4e4a9e"
server_key_iv: "47e4e833db6bf6614819c2367d51bdac"
server_key_version: "encryptionkey@0"
I20260809 22:50:07.710533 29084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:07.733891 29084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:07.738408 29084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:07.738762 29084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:07.739854 29084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:07.741304 29084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:07.741384 29084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:07.741555 29084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:07.741621 29084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:07.777891 29084 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:36103
I20260809 22:50:07.777938 29281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:36103 every 8 connection(s)
I20260809 22:50:07.779337 29084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:07.780761 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 29084
I20260809 22:50:07.780987 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:07.781841 24077 external_mini_cluster.cc:1428] Setting key 333042fbdff2163788b8464c466460b4
Aug 09 22:50:07 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315807, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:07.805660 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:07.782367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53245 (local address 127.23.131.126:45153)
0809 22:50:07.782925 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:07.782929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:07.784151 (+ 1222us) server_negotiation.cc:407] Connection header received
0809 22:50:07.787174 (+ 3023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:07.787178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:07.787310 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:07.787413 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:07.789793 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:07.790545 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:07.793220 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:07.793643 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:07.793751 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:07.797964 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:07.797974 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:07.797982 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:07.798033 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:07.801851 (+ 3818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:07.802741 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:07.802751 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:07.802757 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:07.802918 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:07.803456 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:07.803464 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:07.803470 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:07.803898 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:07.804082 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:07.804855 (+ 773us) server_negotiation.cc:299] Negotiation successful
0809 22:50:07.805143 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":292,"threads_started":1}
I20260809 22:50:07.806351 29286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:07.782986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45153 (local address 127.23.131.65:53245)
0809 22:50:07.783972 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:07.784024 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:07.786818 (+ 2794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:07.787751 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:07.787766 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:07.788653 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:07.789570 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:07.789609 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:07.790771 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:07.790779 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:07.793051 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:07.793070 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:07.793897 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:07.793907 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:07.794264 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:07.795080 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:07.795118 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:07.797670 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:07.802037 (+ 4367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:07.802044 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:07.802060 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:07.802576 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:07.803035 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:07.803038 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:07.803040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:07.803327 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:07.804034 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:07.804041 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:07.804409 (+ 368us) client_negotiation.cc:769] Sending connection context
0809 22:50:07.804666 (+ 257us) client_negotiation.cc:240] Negotiation successful
0809 22:50:07.805111 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":384,"threads_started":1}
I20260809 22:50:07.808295 29282 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45153
I20260809 22:50:07.808655 29282 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:07.809455 29282 heartbeater.cc:511] Master 127.23.131.126:45153 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
I20260809 22:50:07.812223 28990 ts_manager.cc:194] Registered new tserver with Master: 6663b9bfde4148d0a69f050c307ba620 (127.23.131.65:36103)
I20260809 22:50:07.814033 28990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:53245
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:50:07.844662 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45153
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:08.205757 29293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:08.206068 29293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:08.206250 29293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:08.213874 29293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:08.214067 29293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:08.214259 29293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:08.224732 29293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:08.226145 29293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:08.227591 29293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:08.241947 29298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:08.242057 29302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:08.241990 29300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:08.242856 29293 server_base.cc:1034] running on GCE node
I20260809 22:50:08.243549 29293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:08.244661 29293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:08.245874 29293 hybrid_clock.cc:648] HybridClock initialized: now 1786315808245814 us; error 56 us; skew 500 ppm
I20260809 22:50:08.246210 29293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:08 dist-test-slave-92m1 krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:08.249758 29293 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:50:08.251330 29293 webserver.cc:460] Webserver started at http://127.23.131.66:36577/ using document root <none> and password file <none>
I20260809 22:50:08.252069 29293 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:08.252208 29293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:08.252532 29293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:08.255623 29293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "44b45069e219433dad6aa0362bf6654b"
format_stamp: "Formatted at 2026-08-09 22:50:08 on dist-test-slave-92m1"
server_key: "ce1573fdf2adbfa148081bc0c77e42aa"
server_key_iv: "90ccef21c8b13b74d9e7c4370cebbad1"
server_key_version: "encryptionkey@0"
I20260809 22:50:08.256461 29293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "44b45069e219433dad6aa0362bf6654b"
format_stamp: "Formatted at 2026-08-09 22:50:08 on dist-test-slave-92m1"
server_key: "ce1573fdf2adbfa148081bc0c77e42aa"
server_key_iv: "90ccef21c8b13b74d9e7c4370cebbad1"
server_key_version: "encryptionkey@0"
I20260809 22:50:08.261952 29293 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:50:08.265813 29315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:08.267318 29293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:08.267524 29293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "44b45069e219433dad6aa0362bf6654b"
format_stamp: "Formatted at 2026-08-09 22:50:08 on dist-test-slave-92m1"
server_key: "ce1573fdf2adbfa148081bc0c77e42aa"
server_key_iv: "90ccef21c8b13b74d9e7c4370cebbad1"
server_key_version: "encryptionkey@0"
I20260809 22:50:08.267735 29293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:08.319909 29293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:08.324741 29293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:08.325083 29293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:08.326217 29293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:08.327740 29293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:08.327829 29293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:08.327919 29293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:08.327970 29293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:08.363413 29293 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:34579
I20260809 22:50:08.363446 29494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:34579 every 8 connection(s)
I20260809 22:50:08.364727 29293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:08.373215 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 29293
I20260809 22:50:08.373425 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:08.373930 24077 external_mini_cluster.cc:1428] Setting key e43f59d7d887958b622231eaed546880
Aug 09 22:50:08 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:08.387610 29497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:08.367544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:55581 (local address 127.23.131.126:45153)
0809 22:50:08.367970 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:08.367975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:08.369118 (+ 1143us) server_negotiation.cc:407] Connection header received
0809 22:50:08.372022 (+ 2904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:08.372027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:08.372128 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:08.372253 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:08.373986 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.374770 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.376408 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.376843 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.376982 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:08.381127 (+ 4145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:08.381132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:08.381135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:08.381167 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:08.383914 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:08.384880 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:08.384883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:08.384886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:08.385010 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:08.385524 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:08.385527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:08.385529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:08.385781 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:08.385892 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:08.386805 (+ 913us) server_negotiation.cc:299] Negotiation successful
0809 22:50:08.387087 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":210,"threads_started":1}
I20260809 22:50:08.388345 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:08.368117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45153 (local address 127.23.131.66:55581)
0809 22:50:08.368902 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:08.368962 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:08.371712 (+ 2750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:08.372500 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:08.372508 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:08.373114 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:08.373811 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:08.373834 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.374935 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.374940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:08.376247 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:08.376260 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.377089 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.377097 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:08.377337 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:08.378052 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:08.378075 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:08.380877 (+ 2802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:08.384057 (+ 3180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:08.384069 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:08.384088 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:08.384758 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:08.385134 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:08.385142 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:08.385148 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:08.385412 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:08.385907 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:08.385918 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:08.386392 (+ 474us) client_negotiation.cc:769] Sending connection context
0809 22:50:08.386632 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 22:50:08.387048 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":277,"threads_started":1}
I20260809 22:50:08.389863 29495 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45153
I20260809 22:50:08.390213 29495 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:08.391239 29495 heartbeater.cc:511] Master 127.23.131.126:45153 requested a full tablet report, sending...
I20260809 22:50:08.392926 28990 ts_manager.cc:194] Registered new tserver with Master: 44b45069e219433dad6aa0362bf6654b (127.23.131.66:34579)
I20260809 22:50:08.393790 28990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:55581
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:50:08.435590 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45153
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:08.802037 29502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:08.802343 29502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:08.802443 29502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:08.809845 29502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:08.809985 29502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:08.810110 29502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:08.817495 29282 heartbeater.cc:503] Master 127.23.131.126:45153 was elected leader, sending a full tablet report...
I20260809 22:50:08.821185 29502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:08.822621 29502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:08.824110 29502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:08.838857 29510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:08.838971 29516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:08.838989 29509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:08.839892 29502 server_base.cc:1034] running on GCE node
I20260809 22:50:08.840682 29502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:08.841790 29502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:08.843039 29502 hybrid_clock.cc:648] HybridClock initialized: now 1786315808842977 us; error 73 us; skew 500 ppm
I20260809 22:50:08.843431 29502 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:08 dist-test-slave-92m1 krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:08.846922 29502 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:50:08.848623 29502 webserver.cc:460] Webserver started at http://127.23.131.67:36733/ using document root <none> and password file <none>
I20260809 22:50:08.849364 29502 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:08.849535 29502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:08.849882 29502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:08.853159 29502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "091090554226422f8de3e048dee44cbd"
format_stamp: "Formatted at 2026-08-09 22:50:08 on dist-test-slave-92m1"
server_key: "23266085c0b0a90678a45a3b8ffa02bc"
server_key_iv: "9b61183c9066681804932a3f2ae46f81"
server_key_version: "encryptionkey@0"
I20260809 22:50:08.854007 29502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "091090554226422f8de3e048dee44cbd"
format_stamp: "Formatted at 2026-08-09 22:50:08 on dist-test-slave-92m1"
server_key: "23266085c0b0a90678a45a3b8ffa02bc"
server_key_iv: "9b61183c9066681804932a3f2ae46f81"
server_key_version: "encryptionkey@0"
I20260809 22:50:08.859524 29502 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 22:50:08.863255 29524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:08.864599 29502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:08.864789 29502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "091090554226422f8de3e048dee44cbd"
format_stamp: "Formatted at 2026-08-09 22:50:08 on dist-test-slave-92m1"
server_key: "23266085c0b0a90678a45a3b8ffa02bc"
server_key_iv: "9b61183c9066681804932a3f2ae46f81"
server_key_version: "encryptionkey@0"
I20260809 22:50:08.865021 29502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:08.884342 29502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:08.888970 29502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:08.889299 29502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:08.890332 29502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:08.891805 29502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:08.891921 29502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:08.892072 29502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:08.892146 29502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:08.928018 29502 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:36881
I20260809 22:50:08.928061 29696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:36881 every 8 connection(s)
I20260809 22:50:08.929375 29502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:08.934230 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 29502
I20260809 22:50:08.934448 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:08.934914 24077 external_mini_cluster.cc:1428] Setting key 090c4aafea9a832c528e7011a5d02896
Aug 09 22:50:08 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315808, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:08.952183 29701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:08.932009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:57141 (local address 127.23.131.126:45153)
0809 22:50:08.932520 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:08.932525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:08.933438 (+ 913us) server_negotiation.cc:407] Connection header received
0809 22:50:08.935517 (+ 2079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:08.935523 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:08.935623 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:08.935771 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:08.937959 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.938840 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.940472 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.940878 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.941006 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:08.944818 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:08.944824 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:08.944827 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:08.944876 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:08.947661 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:08.949157 (+ 1496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:08.949161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:08.949163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:08.949388 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:08.950036 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:08.950042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:08.950046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:08.950478 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:08.950649 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:08.951669 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0809 22:50:08.951857 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":267,"threads_started":1}
I20260809 22:50:08.953183 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:08.932507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45153 (local address 127.23.131.67:57141)
0809 22:50:08.933243 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:08.933303 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:08.935186 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:08.936100 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:08.936112 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:08.936775 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:08.937739 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:08.937767 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.938995 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.938999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:08.940323 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:08.940336 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:08.941131 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:08.941137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:08.941343 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:08.942020 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:08.942049 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:08.944559 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:08.947891 (+ 3332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:08.947904 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:08.947923 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:08.948975 (+ 1052us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:08.949554 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:08.949562 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:08.949568 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:08.949876 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:08.950636 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:08.950645 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:08.951097 (+ 452us) client_negotiation.cc:769] Sending connection context
0809 22:50:08.951534 (+ 437us) client_negotiation.cc:240] Negotiation successful
0809 22:50:08.951997 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":298,"threads_started":1}
I20260809 22:50:08.954615 29699 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45153
I20260809 22:50:08.954946 29699 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:08.955870 29699 heartbeater.cc:511] Master 127.23.131.126:45153 requested a full tablet report, sending...
I20260809 22:50:08.957350 28990 ts_manager.cc:194] Registered new tserver with Master: 091090554226422f8de3e048dee44cbd (127.23.131.67:36881)
I20260809 22:50:08.958232 28990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:57141
I20260809 22:50:08.963891 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315809, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315809, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:09.030356 29701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:09.014422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.23.131.126:45153)
0809 22:50:09.014672 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:09.014680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:09.015070 (+ 390us) server_negotiation.cc:407] Connection header received
0809 22:50:09.015371 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:09.015376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:09.015464 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:09.015558 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:09.017239 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.018009 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.019487 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.019916 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.020062 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:09.024341 (+ 4279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:09.024347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:09.024350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:09.024392 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:09.027336 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.028152 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.028156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.028159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.028299 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.028742 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.028746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.028748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.029153 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:09.029374 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:09.029739 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 22:50:09.029937 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 22:50:09.031055 28990 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56582
I20260809 22:50:09.033330 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29084
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315809, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:09.050884 29717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:09.034550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.23.131.65:36103)
0809 22:50:09.035336 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:09.035344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:09.035388 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:50:09.035461 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:09.035468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:09.035696 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:09.035836 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:09.037241 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.038287 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.039579 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.040162 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.040264 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:09.044497 (+ 4233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:09.044511 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:09.044526 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:09.044582 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:09.047659 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.048357 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.048365 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.048367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.048601 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.049063 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.049067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.049069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.049532 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:09.049872 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:09.050216 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 22:50:09.050447 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":376,"threads_started":1}
W20260809 22:50:09.052330 29275 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60284
W20260809 22:50:09.053548 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29084: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:50:09.053797 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 29084
I20260809 22:50:09.079667 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29293
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315809, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:50:09.099184 29718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:09.080625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.23.131.66:34579)
0809 22:50:09.081263 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:09.081271 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:09.081298 (+ 27us) server_negotiation.cc:407] Connection header received
0809 22:50:09.081363 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:09.081370 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:09.081587 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:09.081721 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:09.083064 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.084224 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.085523 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.086096 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.086200 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:09.090953 (+ 4753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:09.090973 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:09.090993 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:09.091078 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:09.095397 (+ 4319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.096339 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.096351 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.096356 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.096562 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.097115 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.097122 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.097125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.097657 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:09.098009 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:09.098351 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 22:50:09.098659 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":352,"threads_started":1}
W20260809 22:50:09.100657 29489 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40916
W20260809 22:50:09.101931 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29293: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:50:09.102116 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 29293
I20260809 22:50:09.129066 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29502
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[28929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315809, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:50:09.147135 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:09.130319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52630 (local address 127.23.131.67:36881)
0809 22:50:09.131099 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:09.131106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:09.131138 (+ 32us) server_negotiation.cc:407] Connection header received
0809 22:50:09.131256 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:09.131264 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:09.131495 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:09.131645 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:09.133148 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.134250 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.135661 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:09.136295 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:09.136408 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:09.141185 (+ 4777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:09.141200 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:09.141216 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:09.141256 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:09.144385 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.145080 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.145087 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.145089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.145268 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:09.145609 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:09.145612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:09.145614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:09.145987 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:09.146233 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:09.146497 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 22:50:09.146714 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":443,"threads_started":1}
W20260809 22:50:09.148660 29691 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52630
W20260809 22:50:09.149925 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29502: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:50:09.150128 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 29502
I20260809 22:50:09.181012 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28947
I20260809 22:50:09.182509 29034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:09.291824 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28947
2026-08-09T22:50:09Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4272 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[29728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[29728](info): set up 2 sockets
Aug 09 22:50:09 dist-test-slave-92m1 krb5kdc[29728](info): commencing operation
krb5kdc: starting...
W20260809 22:50:10.668434 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.005s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:10 dist-test-slave-92m1 krb5kdc[29728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:10.940997 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:34455
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:34455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:11.287729 29747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:11.288022 29747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:11.288117 29747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:11.295550 29747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:11.295666 29747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:11.295729 29747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:11.295789 29747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:11.295833 29747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:11.305966 29747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:34455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:34455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:11.307322 29747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:11.308626 29747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:11.321111 29760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:11.321218 29757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:11.321163 29756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:11.322341 29747 server_base.cc:1034] running on GCE node
I20260809 22:50:11.323173 29747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:11.324728 29747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:11.325999 29747 hybrid_clock.cc:648] HybridClock initialized: now 1786315811325926 us; error 48 us; skew 500 ppm
I20260809 22:50:11.326350 29747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:11 dist-test-slave-92m1 krb5kdc[29728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315811, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:11.336133 29747 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:11.337832 29747 webserver.cc:460] Webserver started at http://127.23.131.126:43071/ using document root <none> and password file <none>
I20260809 22:50:11.338606 29747 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:11.338755 29747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:11.339087 29747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:11.342149 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "7233336e3065494592596ed8549a8f27"
format_stamp: "Formatted at 2026-08-09 22:50:11 on dist-test-slave-92m1"
server_key: "fc208e7851cb023ab15b06c4a4d4be61"
server_key_iv: "723f6cf686e10812299b95216492ce67"
server_key_version: "encryptionkey@0"
I20260809 22:50:11.342944 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "7233336e3065494592596ed8549a8f27"
format_stamp: "Formatted at 2026-08-09 22:50:11 on dist-test-slave-92m1"
server_key: "fc208e7851cb023ab15b06c4a4d4be61"
server_key_iv: "723f6cf686e10812299b95216492ce67"
server_key_version: "encryptionkey@0"
I20260809 22:50:11.348353 29747 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 22:50:11.351871 29770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:11.353227 29747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:11.353430 29747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "7233336e3065494592596ed8549a8f27"
format_stamp: "Formatted at 2026-08-09 22:50:11 on dist-test-slave-92m1"
server_key: "fc208e7851cb023ab15b06c4a4d4be61"
server_key_iv: "723f6cf686e10812299b95216492ce67"
server_key_version: "encryptionkey@0"
I20260809 22:50:11.353639 29747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:11.373404 29747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:11.377794 29747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:11.378103 29747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:11.399181 29747 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:34455
I20260809 22:50:11.399247 29854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:34455 every 8 connection(s)
I20260809 22:50:11.400619 29747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:11.404520 29857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:11.407186 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 29747
I20260809 22:50:11.407462 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:11.408298 24077 external_mini_cluster.cc:1428] Setting key d60aa4527be128109b712cee8efe944b
I20260809 22:50:11.417172 29857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27: Bootstrap starting.
I20260809 22:50:11.420998 29857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:11.422355 29857 log.cc:824] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:50:11 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:11.425370 29857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27: No bootstrap required, opened a new log
I20260809 22:50:11.432060 29863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:11.410384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33444 (local address 127.23.131.126:34455)
0809 22:50:11.411161 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:11.411171 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:11.411260 (+ 89us) server_negotiation.cc:407] Connection header received
0809 22:50:11.412944 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:11.412965 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:11.413328 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:11.413647 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:11.415513 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:11.416830 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:11.418582 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:11.419314 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:11.419455 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:11.424566 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:11.424574 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:11.424587 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:11.424621 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:11.427962 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:11.428673 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:11.428683 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:11.428695 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:11.428862 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:11.429258 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:11.429265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:11.429268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:11.429796 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:11.430105 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:11.430581 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 22:50:11.430985 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":381,"threads_started":1}
I20260809 22:50:11.433563 29857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7233336e3065494592596ed8549a8f27" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34455 } }
I20260809 22:50:11.433935 29857 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:11.434080 29857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7233336e3065494592596ed8549a8f27, State: Initialized, Role: FOLLOWER
I20260809 22:50:11.434616 29857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7233336e3065494592596ed8549a8f27" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34455 } }
I20260809 22:50:11.434894 29857 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:11.435060 29857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:11.435292 29857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:11.437515 29857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7233336e3065494592596ed8549a8f27" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34455 } }
I20260809 22:50:11.438023 29857 leader_election.cc:302] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7233336e3065494592596ed8549a8f27; no voters:
I20260809 22:50:11.438635 29857 leader_election.cc:288] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:11.438735 29866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:11.439512 29866 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [term 1 LEADER]: Becoming Leader. State: Replica: 7233336e3065494592596ed8549a8f27, State: Running, Role: LEADER
I20260809 22:50:11.440081 29866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7233336e3065494592596ed8549a8f27" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34455 } }
I20260809 22:50:11.440747 29857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:11.442893 29867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7233336e3065494592596ed8549a8f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7233336e3065494592596ed8549a8f27" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34455 } } }
I20260809 22:50:11.443176 29869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7233336e3065494592596ed8549a8f27. Latest consensus state: current_term: 1 leader_uuid: "7233336e3065494592596ed8549a8f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7233336e3065494592596ed8549a8f27" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34455 } } }
I20260809 22:50:11.443883 29869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:11.443693 29867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:11.447774 29877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:11.452798 29877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:11.462834 29877 catalog_manager.cc:1347] Generated new cluster ID: 182b64065efe4b55a6f91d41459c5ffe
I20260809 22:50:11.463012 29877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:11.475987 29877 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:11.477334 29877 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:11.483433 29877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7233336e3065494592596ed8549a8f27: Generated new TSK 0
I20260809 22:50:11.484277 29877 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:50:11.558892 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34455
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:11.929752 29898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:11.930047 29898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:11.930233 29898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:11.937556 29898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:11.937664 29898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:11.937867 29898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:11.947994 29898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:11.949409 29898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:11.950842 29898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:11.964638 29907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:11.964689 29910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:11.964689 29908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:11.965636 29898 server_base.cc:1034] running on GCE node
I20260809 22:50:11.966287 29898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:11.967319 29898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:11.968547 29898 hybrid_clock.cc:648] HybridClock initialized: now 1786315811968509 us; error 67 us; skew 500 ppm
I20260809 22:50:11.968881 29898 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:11 dist-test-slave-92m1 krb5kdc[29728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315811, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:11.972226 29898 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:50:11.973726 29898 webserver.cc:460] Webserver started at http://127.23.131.65:44293/ using document root <none> and password file <none>
I20260809 22:50:11.974427 29898 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:11.974587 29898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:11.974906 29898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:11.977981 29898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "3d585e5733964ed0b904c23bf4163750"
format_stamp: "Formatted at 2026-08-09 22:50:11 on dist-test-slave-92m1"
server_key: "4feb1ff1ff3c408d4572abbe668e0aa1"
server_key_iv: "4a96c54e842f70d315036e3f91643724"
server_key_version: "encryptionkey@0"
I20260809 22:50:11.978816 29898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "3d585e5733964ed0b904c23bf4163750"
format_stamp: "Formatted at 2026-08-09 22:50:11 on dist-test-slave-92m1"
server_key: "4feb1ff1ff3c408d4572abbe668e0aa1"
server_key_iv: "4a96c54e842f70d315036e3f91643724"
server_key_version: "encryptionkey@0"
I20260809 22:50:11.984812 29898 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 22:50:11.988921 29921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:11.990618 29898 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 22:50:11.990779 29898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "3d585e5733964ed0b904c23bf4163750"
format_stamp: "Formatted at 2026-08-09 22:50:11 on dist-test-slave-92m1"
server_key: "4feb1ff1ff3c408d4572abbe668e0aa1"
server_key_iv: "4a96c54e842f70d315036e3f91643724"
server_key_version: "encryptionkey@0"
I20260809 22:50:11.991006 29898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:12.019146 29898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:12.024487 29898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:12.024775 29898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:12.025770 29898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:12.027254 29898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:12.027370 29898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:12.027470 29898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:12.027513 29898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:12.065173 29898 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:43397
I20260809 22:50:12.065276 30106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:43397 every 8 connection(s)
I20260809 22:50:12.066536 29898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:12.070953 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 29898
I20260809 22:50:12.071197 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:12.072047 24077 external_mini_cluster.cc:1428] Setting key 65c135dbd5166aa76f5881944ca4208b
Aug 09 22:50:12 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315811, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:12.089790 30110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:12.069314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:50731 (local address 127.23.131.126:34455)
0809 22:50:12.069802 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:12.069807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:12.070926 (+ 1119us) server_negotiation.cc:407] Connection header received
0809 22:50:12.073402 (+ 2476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:12.073406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:12.073474 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:12.073568 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:12.075564 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.076346 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.078805 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.079283 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.079396 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:12.083808 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:12.083813 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:12.083816 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:12.083849 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:12.086586 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:12.087407 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:12.087411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:12.087414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:12.087544 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:12.088019 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:12.088023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:12.088025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:12.088291 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:12.088460 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:12.089184 (+ 724us) server_negotiation.cc:299] Negotiation successful
0809 22:50:12.089413 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":250,"threads_started":1}
I20260809 22:50:12.090780 30114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:12.069911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:34455 (local address 127.23.131.65:50731)
0809 22:50:12.070725 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:12.070777 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:12.073098 (+ 2321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:12.073839 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:12.073849 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:12.074528 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:12.075391 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:12.075418 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.076512 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.076521 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:12.078634 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:12.078651 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.079516 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.079525 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:12.079905 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:12.080671 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:12.080707 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:12.083581 (+ 2874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:12.086736 (+ 3155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:12.086745 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:12.086762 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:12.087269 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:12.087660 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:12.087664 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:12.087668 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:12.087887 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:12.088447 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:12.088455 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:12.088795 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 22:50:12.089076 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 22:50:12.089618 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":274,"threads_started":1}
I20260809 22:50:12.092471 30107 heartbeater.cc:347] Connected to a master server at 127.23.131.126:34455
I20260809 22:50:12.092835 30107 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:12.093809 30107 heartbeater.cc:511] Master 127.23.131.126:34455 requested a full tablet report, sending...
I20260809 22:50:12.096563 29799 ts_manager.cc:194] Registered new tserver with Master: 3d585e5733964ed0b904c23bf4163750 (127.23.131.65:43397)
I20260809 22:50:12.098851 29799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:50731
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:50:12.134469 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34455
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:12.482138 30118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:12.482411 30118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:12.482576 30118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:12.490240 30118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:12.490351 30118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:12.490564 30118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:12.500751 30118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:12.502070 30118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:12.503548 30118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:12.517796 30127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:12.517887 30125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:12.518532 30131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:12.524277 30118 server_base.cc:1034] running on GCE node
I20260809 22:50:12.524928 30118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:12.525941 30118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:12.527235 30118 hybrid_clock.cc:648] HybridClock initialized: now 1786315812527144 us; error 51 us; skew 500 ppm
I20260809 22:50:12.527607 30118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:12 dist-test-slave-92m1 krb5kdc[29728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315812, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:12.530977 30118 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:50:12.532757 30118 webserver.cc:460] Webserver started at http://127.23.131.66:38597/ using document root <none> and password file <none>
I20260809 22:50:12.533505 30118 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:12.533665 30118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:12.533999 30118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:12.537122 30118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "0aad26cf67944b39b73968254c87ba3f"
format_stamp: "Formatted at 2026-08-09 22:50:12 on dist-test-slave-92m1"
server_key: "7afe28ece55674749a2a035031d2304a"
server_key_iv: "5c824bf3a9b9232878a6e162edb43663"
server_key_version: "encryptionkey@0"
I20260809 22:50:12.537969 30118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "0aad26cf67944b39b73968254c87ba3f"
format_stamp: "Formatted at 2026-08-09 22:50:12 on dist-test-slave-92m1"
server_key: "7afe28ece55674749a2a035031d2304a"
server_key_iv: "5c824bf3a9b9232878a6e162edb43663"
server_key_version: "encryptionkey@0"
I20260809 22:50:12.543628 30118 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:50:12.547308 30140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:12.548692 30118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:12.548875 30118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "0aad26cf67944b39b73968254c87ba3f"
format_stamp: "Formatted at 2026-08-09 22:50:12 on dist-test-slave-92m1"
server_key: "7afe28ece55674749a2a035031d2304a"
server_key_iv: "5c824bf3a9b9232878a6e162edb43663"
server_key_version: "encryptionkey@0"
I20260809 22:50:12.549154 30118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:12.574306 30118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:12.578686 30118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:12.579021 30118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:12.580168 30118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:12.581612 30118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:12.581719 30118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:12.581876 30118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:12.581950 30118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:12.618361 30118 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:40235
I20260809 22:50:12.618481 30322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:40235 every 8 connection(s)
I20260809 22:50:12.619869 30118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:12.621820 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 30118
I20260809 22:50:12.622046 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:12.622654 24077 external_mini_cluster.cc:1428] Setting key 50d402c6cf7c5e5eb000297a1bf81a60
Aug 09 22:50:12 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315812, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:12.641402 30328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:12.622686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:32859 (local address 127.23.131.126:34455)
0809 22:50:12.623186 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:12.623190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:12.624261 (+ 1071us) server_negotiation.cc:407] Connection header received
0809 22:50:12.626265 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:12.626271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:12.626365 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:12.626492 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:12.628110 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.628854 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.630462 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.630911 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.631053 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:12.634785 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:12.634793 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:12.634801 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:12.634847 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:12.637695 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:12.638708 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:12.638711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:12.638714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:12.638839 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:12.639466 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:12.639470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:12.639472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:12.639771 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:12.639888 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:12.640885 (+ 997us) server_negotiation.cc:299] Negotiation successful
0809 22:50:12.641070 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":251,"threads_started":1}
I20260809 22:50:12.643035 30329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:12.623325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:34455 (local address 127.23.131.66:32859)
0809 22:50:12.624114 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:12.624152 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:12.625997 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:12.626734 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:12.626743 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:12.627353 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:12.627934 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:12.627952 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.629034 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.629038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:12.630301 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:12.630313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:12.631147 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:12.631154 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:12.631428 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:12.632140 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:12.632163 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:12.634537 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:12.637858 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:12.637870 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:12.637891 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:12.638580 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:12.638960 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:12.638968 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:12.638974 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:12.639340 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:12.639915 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:12.639926 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:12.640408 (+ 482us) client_negotiation.cc:769] Sending connection context
0809 22:50:12.640764 (+ 356us) client_negotiation.cc:240] Negotiation successful
0809 22:50:12.641388 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":316,"threads_started":1}
I20260809 22:50:12.644699 30326 heartbeater.cc:347] Connected to a master server at 127.23.131.126:34455
I20260809 22:50:12.645071 30326 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:12.646080 30326 heartbeater.cc:511] Master 127.23.131.126:34455 requested a full tablet report, sending...
I20260809 22:50:12.648007 29799 ts_manager.cc:194] Registered new tserver with Master: 0aad26cf67944b39b73968254c87ba3f (127.23.131.66:40235)
I20260809 22:50:12.649384 29799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:32859
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:50:12.687064 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34455
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:13.026623 30332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:13.026995 30332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:13.027176 30332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:13.034958 30332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:13.035146 30332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:13.035363 30332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:13.046244 30332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:34455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:13.047744 30332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:13.049129 30332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:13.064616 30340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:13.065261 30338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:13.067339 30332 server_base.cc:1034] running on GCE node
W20260809 22:50:13.067848 30344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:13.070740 30332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:13.072057 30332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:13.073318 30332 hybrid_clock.cc:648] HybridClock initialized: now 1786315813073273 us; error 30 us; skew 500 ppm
I20260809 22:50:13.073736 30332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:13.077839 30332 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:50:13.079443 30332 webserver.cc:460] Webserver started at http://127.23.131.67:37177/ using document root <none> and password file <none>
I20260809 22:50:13.080204 30332 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:13.080344 30332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:13.080698 30332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:13.083851 30332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "20f0367cace2438cb3107f58387fda73"
format_stamp: "Formatted at 2026-08-09 22:50:13 on dist-test-slave-92m1"
server_key: "ffa712e7c7abe13ed5c88a3b967828d4"
server_key_iv: "2fe289ff56acc4d7bb6a6841fe8b4964"
server_key_version: "encryptionkey@0"
I20260809 22:50:13.084693 30332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "20f0367cace2438cb3107f58387fda73"
format_stamp: "Formatted at 2026-08-09 22:50:13 on dist-test-slave-92m1"
server_key: "ffa712e7c7abe13ed5c88a3b967828d4"
server_key_iv: "2fe289ff56acc4d7bb6a6841fe8b4964"
server_key_version: "encryptionkey@0"
I20260809 22:50:13.090097 30332 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:50:13.093873 30352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:13.095371 30332 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:13.095564 30332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "20f0367cace2438cb3107f58387fda73"
format_stamp: "Formatted at 2026-08-09 22:50:13 on dist-test-slave-92m1"
server_key: "ffa712e7c7abe13ed5c88a3b967828d4"
server_key_iv: "2fe289ff56acc4d7bb6a6841fe8b4964"
server_key_version: "encryptionkey@0"
I20260809 22:50:13.095793 30332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:13.102219 30107 heartbeater.cc:503] Master 127.23.131.126:34455 was elected leader, sending a full tablet report...
I20260809 22:50:13.117865 30332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:13.122583 30332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:13.122850 30332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:13.123926 30332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:13.125357 30332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:13.125481 30332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:13.125638 30332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:13.125691 30332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:13.162489 30332 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:44245
I20260809 22:50:13.162592 30520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:44245 every 8 connection(s)
I20260809 22:50:13.163841 30332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:13.165227 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 30332
I20260809 22:50:13.165438 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:13.166011 24077 external_mini_cluster.cc:1428] Setting key d58d38cded81cb14ffe2a011bc5202fe
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:13.185721 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.166907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:40085 (local address 127.23.131.126:34455)
0809 22:50:13.167479 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:13.167487 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:13.168766 (+ 1279us) server_negotiation.cc:407] Connection header received
0809 22:50:13.170632 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:13.170636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:13.170711 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:13.170803 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:13.172377 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.173181 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.174748 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.175193 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.175385 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.178991 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:13.178996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:13.179000 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:13.179037 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:13.182468 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.183242 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.183249 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.183252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.183392 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.183853 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.183859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.183862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.184152 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:13.184327 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:13.185083 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 22:50:13.185314 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":294,"threads_started":1}
I20260809 22:50:13.186687 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.167630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:34455 (local address 127.23.131.67:40085)
0809 22:50:13.168587 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:13.168646 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:13.170369 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:13.171047 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:13.171055 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:13.171657 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:13.172211 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:13.172227 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.173319 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.173323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:13.174587 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:13.174600 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.175466 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.175471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:13.175682 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.176355 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:13.176377 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:13.178744 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:13.182612 (+ 3868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:13.182622 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:13.182639 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:13.183085 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:13.183513 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:13.183517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:13.183521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:13.183730 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:13.184311 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:13.184319 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:13.184696 (+ 377us) client_negotiation.cc:769] Sending connection context
0809 22:50:13.184986 (+ 290us) client_negotiation.cc:240] Negotiation successful
0809 22:50:13.185566 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":457,"threads_started":1}
I20260809 22:50:13.188066 30522 heartbeater.cc:347] Connected to a master server at 127.23.131.126:34455
I20260809 22:50:13.188406 30522 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:13.189136 30522 heartbeater.cc:511] Master 127.23.131.126:34455 requested a full tablet report, sending...
I20260809 22:50:13.190636 29799 ts_manager.cc:194] Registered new tserver with Master: 20f0367cace2438cb3107f58387fda73 (127.23.131.67:44245)
I20260809 22:50:13.191514 29799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:40085
I20260809 22:50:13.194494 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:13.258889 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.243100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60314 (local address 127.23.131.65:43397)
0809 22:50:13.243803 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:13.243810 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:13.243839 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:50:13.243900 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:13.243906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:13.244143 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:13.244291 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:13.245716 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.246734 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.248010 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.248559 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.248657 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.252969 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:13.252982 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:13.252997 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:13.253073 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:13.256143 (+ 3070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.256826 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.256835 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.256838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.257059 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.257437 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.257445 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.257448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.257884 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:13.258135 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:13.258388 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 22:50:13.258597 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":394,"threads_started":1}
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:13.278129 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.264048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33458 (local address 127.23.131.126:34455)
0809 22:50:13.264258 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:13.264263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:13.264313 (+ 50us) server_negotiation.cc:407] Connection header received
0809 22:50:13.264485 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:13.264488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:13.264568 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:13.264649 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:13.265979 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.266697 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.268020 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.268437 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.268552 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.272642 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:13.272647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:13.272650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:13.272687 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:13.275460 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.276115 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.276119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.276121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.276282 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.276649 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.276653 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.276656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.277061 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:13.277282 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:13.277537 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 22:50:13.277718 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260809 22:50:13.278774 29799 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33458
I20260809 22:50:13.280005 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29898
I20260809 22:50:13.293709 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.281148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60326 (local address 127.23.131.65:43397)
0809 22:50:13.281372 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:13.281379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:13.281483 (+ 104us) server_negotiation.cc:407] Connection header received
0809 22:50:13.281696 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:13.281700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:13.281796 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:13.281907 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:13.283242 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.283957 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.285224 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.285676 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.285818 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.288345 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:13.288350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:13.288354 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:13.288391 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:13.290991 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.291728 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.291735 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.291739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.291875 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.292262 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.292268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.292271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.292552 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:13.292824 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:13.293144 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 22:50:13.293378 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:50:13.294456 30101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:13.380564 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 29898
I20260809 22:50:13.408242 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 30118
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:50:13.425458 30540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.409307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33408 (local address 127.23.131.66:40235)
0809 22:50:13.410005 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:13.410013 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:13.410040 (+ 27us) server_negotiation.cc:407] Connection header received
0809 22:50:13.410105 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:13.410112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:13.410334 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:13.410467 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:13.411833 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.412958 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.414236 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.414785 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.414890 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.419347 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:13.419359 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:13.419374 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:13.419412 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:13.422488 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.423176 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.423183 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.423185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.423378 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.423768 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.423789 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.423791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.424211 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:13.424458 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:13.424801 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 22:50:13.425121 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":371,"threads_started":1}
I20260809 22:50:13.426895 30317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:13.512010 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 30118
I20260809 22:50:13.538089 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 30332
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[29728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:50:13.558995 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:13.539008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54586 (local address 127.23.131.67:44245)
0809 22:50:13.539733 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:13.539740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:13.539771 (+ 31us) server_negotiation.cc:407] Connection header received
0809 22:50:13.539839 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:13.539845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:13.540067 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:13.540289 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:13.542196 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.543804 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.545798 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:13.546723 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:13.550993 (+ 4270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:13.553192 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:13.553206 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:13.553221 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:13.553260 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:13.556158 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.556864 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.556873 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.556876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.557018 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:13.557428 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:13.557432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:13.557435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:13.557856 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:13.558194 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:13.558482 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 22:50:13.558694 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":389,"threads_started":1}
I20260809 22:50:13.560416 30516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:13.645593 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 30332
I20260809 22:50:13.668390 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 29747
I20260809 22:50:13.669625 29849 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:13.779551 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 29747
2026-08-09T22:50:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4487 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[30552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[30552](info): set up 2 sockets
Aug 09 22:50:13 dist-test-slave-92m1 krb5kdc[30552](info): commencing operation
krb5kdc: starting...
W20260809 22:50:15.147073 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:15 dist-test-slave-92m1 krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:15.422557 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41577
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:15.773132 30581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:15.773447 30581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:15.773546 30581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:15.780926 30581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:15.781049 30581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:15.781097 30581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:15.781152 30581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:15.781203 30581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:15.791595 30581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:15.792972 30581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:15.794322 30581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:15.811642 30590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:15.811672 30591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:15.811708 30594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:15.813028 30581 server_base.cc:1034] running on GCE node
I20260809 22:50:15.813999 30581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:15.815768 30581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:15.817022 30581 hybrid_clock.cc:648] HybridClock initialized: now 1786315815816983 us; error 42 us; skew 500 ppm
I20260809 22:50:15.817414 30581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:15 dist-test-slave-92m1 krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315815, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:15.820930 30581 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:15.822208 30581 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:15.822306 30581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:15.822602 30581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:15.825815 30581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "4211888693674a069647b11d184f2d74"
format_stamp: "Formatted at 2026-08-09 22:50:15 on dist-test-slave-92m1"
server_key: "a49771e92d6686e314af204fbe345375"
server_key_iv: "2138494fcb39a7b085f39e8892511230"
server_key_version: "encryptionkey@0"
I20260809 22:50:15.826623 30581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "4211888693674a069647b11d184f2d74"
format_stamp: "Formatted at 2026-08-09 22:50:15 on dist-test-slave-92m1"
server_key: "a49771e92d6686e314af204fbe345375"
server_key_iv: "2138494fcb39a7b085f39e8892511230"
server_key_version: "encryptionkey@0"
I20260809 22:50:15.832234 30581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260809 22:50:15.836052 30602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:15.837423 30581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:15.837618 30581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "4211888693674a069647b11d184f2d74"
format_stamp: "Formatted at 2026-08-09 22:50:15 on dist-test-slave-92m1"
server_key: "a49771e92d6686e314af204fbe345375"
server_key_iv: "2138494fcb39a7b085f39e8892511230"
server_key_version: "encryptionkey@0"
I20260809 22:50:15.837865 30581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:15.854506 30581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:15.859107 30581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:15.859426 30581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:15.879472 30581 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41577
I20260809 22:50:15.879426 30678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41577 every 8 connection(s)
I20260809 22:50:15.880443 30581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:15.884220 30679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:15.890069 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 30581
I20260809 22:50:15.890323 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:15.890987 24077 external_mini_cluster.cc:1428] Setting key 8ebd5bc3074cacc93e850a65941e795f
I20260809 22:50:15.896075 30679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74: Bootstrap starting.
I20260809 22:50:15.899871 30679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:15.901194 30679 log.cc:824] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:15.904075 30679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74: No bootstrap required, opened a new log
Aug 09 22:50:15 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:15.912791 30679 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4211888693674a069647b11d184f2d74" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41577 } }
I20260809 22:50:15.913201 30679 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:15.913329 30679 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4211888693674a069647b11d184f2d74, State: Initialized, Role: FOLLOWER
I20260809 22:50:15.914083 30679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4211888693674a069647b11d184f2d74" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41577 } }
I20260809 22:50:15.914384 30679 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:15.914590 30679 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:15.914789 30679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:15.915887 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:15.893187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33742 (local address 127.23.131.126:41577)
0809 22:50:15.894011 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:15.894026 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:15.894075 (+ 49us) server_negotiation.cc:407] Connection header received
0809 22:50:15.896608 (+ 2533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:15.896636 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:15.897112 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:15.897524 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:15.899011 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:15.901128 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:15.902543 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:15.903243 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:15.903475 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:15.907775 (+ 4300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:15.907783 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:15.907799 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:15.907836 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:15.911066 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:15.911907 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:15.911914 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:15.911921 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:15.912103 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:15.912557 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:15.912562 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:15.912565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:15.913226 (+ 661us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:15.913587 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:15.914186 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 22:50:15.914635 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":374,"threads_started":1}
I20260809 22:50:15.917667 30679 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4211888693674a069647b11d184f2d74" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41577 } }
I20260809 22:50:15.918275 30679 leader_election.cc:302] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4211888693674a069647b11d184f2d74; no voters:
I20260809 22:50:15.918993 30679 leader_election.cc:288] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:15.919179 30685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:15.919992 30685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [term 1 LEADER]: Becoming Leader. State: Replica: 4211888693674a069647b11d184f2d74, State: Running, Role: LEADER
I20260809 22:50:15.920662 30685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4211888693674a069647b11d184f2d74" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41577 } }
I20260809 22:50:15.921257 30679 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:15.923848 30688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4211888693674a069647b11d184f2d74. Latest consensus state: current_term: 1 leader_uuid: "4211888693674a069647b11d184f2d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4211888693674a069647b11d184f2d74" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41577 } } }
I20260809 22:50:15.923818 30687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4211888693674a069647b11d184f2d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4211888693674a069647b11d184f2d74" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41577 } } }
I20260809 22:50:15.924239 30688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:15.924304 30687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:15.928400 30697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:15.933564 30697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:15.942209 30697 catalog_manager.cc:1347] Generated new cluster ID: 4087611d57284d9195ee60bdc03c8862
I20260809 22:50:15.942343 30697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:15.975059 30697 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:15.977097 30697 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:15.998687 30697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74: Generated new TSK 0
I20260809 22:50:15.999792 30697 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:50:16.073240 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41577
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:16.442965 30723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:16.443375 30723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:16.443578 30723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:16.451357 30723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:16.451519 30723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:16.451725 30723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:16.462177 30723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:16.463707 30723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:16.465171 30723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:16.479386 30734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:16.479629 30737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:16.479972 30733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:16.480285 30723 server_base.cc:1034] running on GCE node
I20260809 22:50:16.480930 30723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:16.481846 30723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:16.483069 30723 hybrid_clock.cc:648] HybridClock initialized: now 1786315816483019 us; error 47 us; skew 500 ppm
I20260809 22:50:16.483453 30723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:16 dist-test-slave-92m1 krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315816, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:16.489504 30723 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:50:16.490739 30723 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:16.490834 30723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:16.491096 30723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:16.494143 30723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "6a56d24cdf2a4aeb9230ca988ab4414a"
format_stamp: "Formatted at 2026-08-09 22:50:16 on dist-test-slave-92m1"
server_key: "99927787f01b9df037cbdf8b92001fec"
server_key_iv: "d010f9764c9a990ec90aa8f0cdde7f78"
server_key_version: "encryptionkey@0"
I20260809 22:50:16.494927 30723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "6a56d24cdf2a4aeb9230ca988ab4414a"
format_stamp: "Formatted at 2026-08-09 22:50:16 on dist-test-slave-92m1"
server_key: "99927787f01b9df037cbdf8b92001fec"
server_key_iv: "d010f9764c9a990ec90aa8f0cdde7f78"
server_key_version: "encryptionkey@0"
I20260809 22:50:16.500272 30723 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 22:50:16.503691 30746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:16.504971 30723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 22:50:16.505146 30723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "6a56d24cdf2a4aeb9230ca988ab4414a"
format_stamp: "Formatted at 2026-08-09 22:50:16 on dist-test-slave-92m1"
server_key: "99927787f01b9df037cbdf8b92001fec"
server_key_iv: "d010f9764c9a990ec90aa8f0cdde7f78"
server_key_version: "encryptionkey@0"
I20260809 22:50:16.505359 30723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:16.519096 30723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:16.523677 30723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:16.523953 30723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:16.524879 30723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:16.526196 30723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:16.526309 30723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:16.526438 30723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:16.526535 30723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:16.562234 30723 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:44875
I20260809 22:50:16.562290 30945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:44875 every 8 connection(s)
I20260809 22:50:16.563139 30723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:16.572177 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 30723
I20260809 22:50:16.572420 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:16.573256 24077 external_mini_cluster.cc:1428] Setting key b3b85dadda31b7da1de1f5a1b82a35c6
Aug 09 22:50:16 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315816, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:16.586750 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:16.565748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58125 (local address 127.23.131.126:41577)
0809 22:50:16.566239 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:16.566245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:16.567245 (+ 1000us) server_negotiation.cc:407] Connection header received
0809 22:50:16.569041 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:16.569045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:16.569133 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:16.569234 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:16.570786 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:16.571742 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:16.574166 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:16.574624 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:16.574765 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:16.579077 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:16.579087 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:16.579094 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:16.579142 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:16.582876 (+ 3734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:16.583861 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:16.583869 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:16.583876 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:16.584050 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:16.584578 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:16.584585 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:16.584591 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:16.585027 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:16.585190 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:16.585974 (+ 784us) server_negotiation.cc:299] Negotiation successful
0809 22:50:16.586262 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":230,"threads_started":1}
I20260809 22:50:16.587533 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:16.566324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41577 (local address 127.23.131.65:58125)
0809 22:50:16.567046 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:16.567096 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:16.568778 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:16.569487 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:16.569496 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:16.570039 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:16.570590 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:16.570606 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:16.571937 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:16.571943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:16.573996 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:16.574008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:16.574904 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:16.574911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:16.575185 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:16.575982 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:16.576019 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:16.578837 (+ 2818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:16.583067 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:16.583075 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:16.583093 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:16.583719 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:16.584212 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:16.584216 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:16.584219 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:16.584436 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:16.585160 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:16.585167 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:16.585550 (+ 383us) client_negotiation.cc:769] Sending connection context
0809 22:50:16.585806 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 22:50:16.586251 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":288,"threads_started":1}
I20260809 22:50:16.589349 30949 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41577
I20260809 22:50:16.589702 30949 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:16.590548 30949 heartbeater.cc:511] Master 127.23.131.126:41577 requested a full tablet report, sending...
I20260809 22:50:16.592993 30630 ts_manager.cc:194] Registered new tserver with Master: 6a56d24cdf2a4aeb9230ca988ab4414a (127.23.131.65:44875)
I20260809 22:50:16.594550 30630 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:58125
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:50:16.636773 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41577
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:17.002177 30958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:17.002561 30958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:17.002760 30958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:17.010746 30958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:17.010927 30958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:17.011119 30958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:17.021740 30958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:17.023371 30958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:17.024816 30958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:17.039399 30966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:17.039358 30967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:17.040033 30958 server_base.cc:1034] running on GCE node
W20260809 22:50:17.040141 30977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:17.040915 30958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:17.041952 30958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:17.043148 30958 hybrid_clock.cc:648] HybridClock initialized: now 1786315817043106 us; error 34 us; skew 500 ppm
I20260809 22:50:17.043510 30958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:17 dist-test-slave-92m1 krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315817, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:17.046948 30958 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:50:17.048147 30958 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:17.048245 30958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:17.048503 30958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:17.051461 30958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "8cd44a76ccbd4979a30697f423dd26ce"
format_stamp: "Formatted at 2026-08-09 22:50:17 on dist-test-slave-92m1"
server_key: "db6b895b64e3d2f84b1b0fcd60fe48a8"
server_key_iv: "61e70199b56aa77b30d09a054a0468ae"
server_key_version: "encryptionkey@0"
I20260809 22:50:17.052222 30958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "8cd44a76ccbd4979a30697f423dd26ce"
format_stamp: "Formatted at 2026-08-09 22:50:17 on dist-test-slave-92m1"
server_key: "db6b895b64e3d2f84b1b0fcd60fe48a8"
server_key_iv: "61e70199b56aa77b30d09a054a0468ae"
server_key_version: "encryptionkey@0"
I20260809 22:50:17.057211 30958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 22:50:17.060777 30985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:17.062300 30958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 22:50:17.062496 30958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "8cd44a76ccbd4979a30697f423dd26ce"
format_stamp: "Formatted at 2026-08-09 22:50:17 on dist-test-slave-92m1"
server_key: "db6b895b64e3d2f84b1b0fcd60fe48a8"
server_key_iv: "61e70199b56aa77b30d09a054a0468ae"
server_key_version: "encryptionkey@0"
I20260809 22:50:17.062718 30958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:17.077610 30958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:17.082296 30958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:17.082608 30958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:17.083712 30958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:17.085242 30958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:17.085330 30958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:17.085487 30958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:17.085588 30958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:17.119638 30958 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:38529
I20260809 22:50:17.119699 31161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:38529 every 8 connection(s)
I20260809 22:50:17.120525 30958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:17.125756 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 30958
I20260809 22:50:17.126029 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:17.126526 24077 external_mini_cluster.cc:1428] Setting key f141a3714ec9f8d2613125e74ad46282
Aug 09 22:50:17 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315817, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:17.142035 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.123374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:53497 (local address 127.23.131.126:41577)
0809 22:50:17.123868 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:17.123873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:17.124748 (+ 875us) server_negotiation.cc:407] Connection header received
0809 22:50:17.126839 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:17.126845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:17.126937 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:17.127061 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:17.128761 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.129610 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.131196 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.131667 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.131809 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.135389 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:17.135394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:17.135397 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:17.135433 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:17.138221 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:17.139076 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:17.139084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:17.139088 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:17.139295 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:17.139791 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:17.139797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:17.139801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:17.140228 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:17.140400 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:17.141148 (+ 748us) server_negotiation.cc:299] Negotiation successful
0809 22:50:17.141484 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":260,"threads_started":1}
I20260809 22:50:17.142755 31169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.123846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41577 (local address 127.23.131.66:53497)
0809 22:50:17.124584 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:17.124622 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:17.126537 (+ 1915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:17.127334 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:17.127342 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:17.127959 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:17.128588 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.128608 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.129764 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.129768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.131038 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.131050 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.131906 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.131913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.132142 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.132879 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:17.132907 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:17.135134 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:17.138383 (+ 3249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:17.138393 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:17.138411 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:17.138907 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:17.139436 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:17.139440 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:17.139443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:17.139642 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:17.140376 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:17.140383 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:17.140734 (+ 351us) client_negotiation.cc:769] Sending connection context
0809 22:50:17.141007 (+ 273us) client_negotiation.cc:240] Negotiation successful
0809 22:50:17.141533 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":308,"threads_started":1}
I20260809 22:50:17.144316 31162 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41577
I20260809 22:50:17.144670 31162 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:17.145640 31162 heartbeater.cc:511] Master 127.23.131.126:41577 requested a full tablet report, sending...
I20260809 22:50:17.147487 30630 ts_manager.cc:194] Registered new tserver with Master: 8cd44a76ccbd4979a30697f423dd26ce (127.23.131.66:38529)
I20260809 22:50:17.148344 30630 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:53497
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:50:17.190243 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41577
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:17.534960 31173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:17.535346 31173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:17.535537 31173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:17.545805 31173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:17.545980 31173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:17.546231 31173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:17.557369 31173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:17.558768 31173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:17.560249 31173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:17.575083 31178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:17.575145 31179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:17.575169 31183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:17.576773 31173 server_base.cc:1034] running on GCE node
I20260809 22:50:17.577416 31173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:17.578442 31173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:17.579680 31173 hybrid_clock.cc:648] HybridClock initialized: now 1786315817579640 us; error 61 us; skew 500 ppm
I20260809 22:50:17.580042 31173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:17 dist-test-slave-92m1 krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315817, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:17.583473 31173 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:50:17.584753 31173 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:17.584848 31173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:17.585109 31173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:17.588189 31173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "9fa9b54e4fb748a7ba05fa56be7c5639"
format_stamp: "Formatted at 2026-08-09 22:50:17 on dist-test-slave-92m1"
server_key: "fe003ad36711201823fafeadb9227ec4"
server_key_iv: "4466321fe6495e7f9b59a11a8e200e50"
server_key_version: "encryptionkey@0"
I20260809 22:50:17.589030 31173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "9fa9b54e4fb748a7ba05fa56be7c5639"
format_stamp: "Formatted at 2026-08-09 22:50:17 on dist-test-slave-92m1"
server_key: "fe003ad36711201823fafeadb9227ec4"
server_key_iv: "4466321fe6495e7f9b59a11a8e200e50"
server_key_version: "encryptionkey@0"
I20260809 22:50:17.594177 31173 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:17.597774 31190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:17.598739 30949 heartbeater.cc:503] Master 127.23.131.126:41577 was elected leader, sending a full tablet report...
I20260809 22:50:17.599527 31173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:17.599711 31173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "9fa9b54e4fb748a7ba05fa56be7c5639"
format_stamp: "Formatted at 2026-08-09 22:50:17 on dist-test-slave-92m1"
server_key: "fe003ad36711201823fafeadb9227ec4"
server_key_iv: "4466321fe6495e7f9b59a11a8e200e50"
server_key_version: "encryptionkey@0"
I20260809 22:50:17.599941 31173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:17.624410 31173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:17.629097 31173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:17.629415 31173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:17.630471 31173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:17.631996 31173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:17.632123 31173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:17.632264 31173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:17.632354 31173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:17.668664 31173 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:40217
I20260809 22:50:17.668757 31373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:40217 every 8 connection(s)
I20260809 22:50:17.669593 31173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:17.678328 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 31173
I20260809 22:50:17.678555 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:17.679076 24077 external_mini_cluster.cc:1428] Setting key d42a10f94d3b0a3209d0d487930854ee
Aug 09 22:50:17 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315817, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:17.691669 31377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.672543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:55233 (local address 127.23.131.126:41577)
0809 22:50:17.673121 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:17.673128 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:17.674003 (+ 875us) server_negotiation.cc:407] Connection header received
0809 22:50:17.676071 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:17.676075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:17.676161 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:17.676262 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:17.677966 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.678864 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.681311 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.681924 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.682072 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.685818 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:17.685823 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:17.685826 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:17.685860 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:17.688666 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:17.689450 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:17.689455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:17.689457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:17.689589 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:17.690015 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:17.690018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:17.690020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:17.690290 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:17.690414 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:17.691128 (+ 714us) server_negotiation.cc:299] Negotiation successful
0809 22:50:17.691375 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":307,"threads_started":1}
I20260809 22:50:17.692689 31378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.672978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41577 (local address 127.23.131.67:55233)
0809 22:50:17.673812 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:17.673859 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:17.675758 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:17.676517 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:17.676526 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:17.677102 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:17.677722 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.677741 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.679038 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.679045 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.681139 (+ 2094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.681156 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.682174 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.682179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.682485 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.683308 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:17.683332 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:17.685615 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:17.688816 (+ 3201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:17.688824 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:17.688838 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:17.689290 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:17.689693 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:17.689696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:17.689699 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:17.689891 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:17.690410 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:17.690416 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:17.690746 (+ 330us) client_negotiation.cc:769] Sending connection context
0809 22:50:17.690983 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 22:50:17.691497 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":352,"threads_started":1}
I20260809 22:50:17.694258 31374 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41577
I20260809 22:50:17.694675 31374 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:17.695564 31374 heartbeater.cc:511] Master 127.23.131.126:41577 requested a full tablet report, sending...
I20260809 22:50:17.697117 30629 ts_manager.cc:194] Registered new tserver with Master: 9fa9b54e4fb748a7ba05fa56be7c5639 (127.23.131.67:40217)
I20260809 22:50:17.698060 30629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:55233
I20260809 22:50:17.707895 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:50:17.725960 31377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.712786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33746 (local address 127.23.131.126:41577)
0809 22:50:17.712973 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:17.712978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:17.713613 (+ 635us) server_negotiation.cc:407] Connection header received
0809 22:50:17.713836 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:17.713840 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:17.713908 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:17.714014 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:17.715660 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.716404 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.717645 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.718169 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.718316 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.720728 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:17.720733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:17.720737 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:17.720769 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:17.723488 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:17.724101 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:17.724105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:17.724107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:17.724221 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:17.724554 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:17.724557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:17.724559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:17.724876 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:17.725086 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:17.725451 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 22:50:17.725635 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 22:50:17.730611 30629 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33746:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:17.738353 30629 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:17.775070 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.751343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38306 (local address 127.23.131.67:40217)
0809 22:50:17.764660 (+ 13317us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:17.764674 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:17.764718 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:50:17.764857 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:17.764869 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:17.765213 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:17.765488 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:17.766567 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.768606 (+ 2039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.772132 (+ 3526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.773733 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.773882 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.774119 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:17.774522 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 22:50:17.774706 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13071,"thread_start_us":12864,"threads_started":1}
I20260809 22:50:17.775104 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.751078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:40217 (local address 127.0.0.1:38306)
0809 22:50:17.763441 (+ 12363us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:17.763502 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:17.763752 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:17.765687 (+ 1935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:17.765695 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:17.765724 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:17.766242 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.766260 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.768790 (+ 2530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.768798 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.771875 (+ 3077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.771886 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.773950 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.773956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.774198 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.774289 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 22:50:17.774407 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 22:50:17.774643 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11951,"mutex_wait_us":39,"thread_start_us":13443,"threads_started":1}
I20260809 22:50:17.777194 31395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.751309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38529 (local address 127.0.0.1:39294)
0809 22:50:17.766489 (+ 15180us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:17.766510 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:17.766624 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:17.768171 (+ 1547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:17.768179 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:17.768214 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:17.770148 (+ 1934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.770168 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.772275 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.772280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.774289 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.774301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.776249 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.776261 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.776445 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.776482 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 22:50:17.776564 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 22:50:17.776723 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15037,"mutex_wait_us":28,"thread_start_us":14847,"threads_started":1}
I20260809 22:50:17.777334 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.751623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39294 (local address 127.23.131.66:38529)
0809 22:50:17.767150 (+ 15527us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:17.767158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:17.767186 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:50:17.767320 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:17.767331 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:17.767642 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:17.767861 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:17.770414 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.772092 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.774478 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.776008 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.776148 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.776329 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:17.776798 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 22:50:17.776995 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15303,"thread_start_us":15130,"threads_started":1}
I20260809 22:50:17.779058 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.767279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49598)
0809 22:50:17.771173 (+ 3894us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:17.771191 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:17.771318 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:17.772011 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:17.772018 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:17.772049 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:17.772522 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.772534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.774416 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.774423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.776333 (+ 1910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:17.776346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.778245 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.778252 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:17.778433 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.778489 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 22:50:17.778589 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 22:50:17.778722 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3751,"thread_start_us":3603,"threads_started":1}
I20260809 22:50:17.779160 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:17.767009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49598 (local address 127.23.131.65:44875)
0809 22:50:17.771417 (+ 4408us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:17.771425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:17.771469 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:50:17.771566 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:17.771574 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:17.771794 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:17.771992 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:17.772805 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.774275 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.776523 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:17.778031 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:17.778177 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:17.778438 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:17.778655 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 22:50:17.778816 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3667,"thread_start_us":3496,"threads_started":1}
I20260809 22:50:17.780596 31269 tablet_service.cc:1467] Processing CreateTablet for tablet bd6879ab58de415eabba729e932acd97 (DEFAULT_TABLE table=test-table [id=a5ccbefaa5fd4b7ba299eff97843c2dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:17.781270 31062 tablet_service.cc:1467] Processing CreateTablet for tablet bd6879ab58de415eabba729e932acd97 (DEFAULT_TABLE table=test-table [id=a5ccbefaa5fd4b7ba299eff97843c2dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:17.782124 31269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6879ab58de415eabba729e932acd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:17.782656 31062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6879ab58de415eabba729e932acd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:17.782725 30835 tablet_service.cc:1467] Processing CreateTablet for tablet bd6879ab58de415eabba729e932acd97 (DEFAULT_TABLE table=test-table [id=a5ccbefaa5fd4b7ba299eff97843c2dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:17.784166 30835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6879ab58de415eabba729e932acd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:17.794207 31404 tablet_bootstrap.cc:492] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Bootstrap starting.
I20260809 22:50:17.797947 31405 tablet_bootstrap.cc:492] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Bootstrap starting.
I20260809 22:50:17.798794 31404 tablet_bootstrap.cc:654] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:17.799636 31408 tablet_bootstrap.cc:492] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: Bootstrap starting.
I20260809 22:50:17.800791 31404 log.cc:824] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:17.801807 31405 tablet_bootstrap.cc:654] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:17.802723 31408 tablet_bootstrap.cc:654] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:17.803016 31405 log.cc:824] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:17.804037 31408 log.cc:824] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:17.804837 31404 tablet_bootstrap.cc:492] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: No bootstrap required, opened a new log
I20260809 22:50:17.805146 31404 ts_tablet_manager.cc:1397] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260809 22:50:17.806802 31405 tablet_bootstrap.cc:492] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: No bootstrap required, opened a new log
I20260809 22:50:17.807094 31405 ts_tablet_manager.cc:1397] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 22:50:17.813442 31408 tablet_bootstrap.cc:492] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: No bootstrap required, opened a new log
I20260809 22:50:17.813727 31408 ts_tablet_manager.cc:1397] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20260809 22:50:17.816623 31404 raft_consensus.cc:348] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:17.817225 31404 raft_consensus.cc:374] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:17.817337 31404 raft_consensus.cc:729] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa9b54e4fb748a7ba05fa56be7c5639, State: Initialized, Role: FOLLOWER
I20260809 22:50:17.817997 31404 consensus_queue.cc:260] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:17.818253 31405 raft_consensus.cc:348] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:17.818863 31405 raft_consensus.cc:374] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:17.819284 31374 heartbeater.cc:503] Master 127.23.131.126:41577 was elected leader, sending a full tablet report...
I20260809 22:50:17.819981 31404 ts_tablet_manager.cc:1428] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
I20260809 22:50:17.819025 31405 raft_consensus.cc:729] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd44a76ccbd4979a30697f423dd26ce, State: Initialized, Role: FOLLOWER
I20260809 22:50:17.821023 31405 consensus_queue.cc:260] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:17.822227 31162 heartbeater.cc:503] Master 127.23.131.126:41577 was elected leader, sending a full tablet report...
I20260809 22:50:17.822844 31405 ts_tablet_manager.cc:1428] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260809 22:50:17.822858 31408 raft_consensus.cc:348] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:17.823387 31408 raft_consensus.cc:374] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:17.823501 31408 raft_consensus.cc:729] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a56d24cdf2a4aeb9230ca988ab4414a, State: Initialized, Role: FOLLOWER
I20260809 22:50:17.824260 31408 consensus_queue.cc:260] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:17.826607 31408 ts_tablet_manager.cc:1428] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
W20260809 22:50:17.872493 31164 tablet.cc:2369] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:50:17.921350 31375 tablet.cc:2369] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:50:18.065650 30950 tablet.cc:2369] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:50:18.130439 31417 raft_consensus.cc:482] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:18.130723 31417 raft_consensus.cc:504] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:18.132716 31417 leader_election.cc:288] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa9b54e4fb748a7ba05fa56be7c5639 (127.23.131.67:40217), 8cd44a76ccbd4979a30697f423dd26ce (127.23.131.66:38529)
I20260809 22:50:18.139914 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.133147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:43499 (local address 127.23.131.66:38529)
0809 22:50:18.133363 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:18.133372 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:18.134325 (+ 953us) server_negotiation.cc:407] Connection header received
0809 22:50:18.134529 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:18.134533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:18.134589 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:18.134683 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:18.135501 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.136212 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.138090 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.138851 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.139034 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.139116 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:18.139521 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 22:50:18.139654 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 22:50:18.139936 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.133274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:41515 (local address 127.23.131.67:40217)
0809 22:50:18.133509 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:18.133518 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:18.134231 (+ 713us) server_negotiation.cc:407] Connection header received
0809 22:50:18.134482 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:18.134491 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:18.134555 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:18.134652 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:18.135482 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.136216 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.138087 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.138880 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.139081 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.139165 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:18.139538 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 22:50:18.139671 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 22:50:18.140082 31421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.133450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38529 (local address 127.23.131.65:43499)
0809 22:50:18.134211 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.134224 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:18.134379 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:18.134697 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:18.134702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:18.134724 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:18.135320 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:18.135331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.136367 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.136372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:18.137929 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:18.137941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.139102 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.139108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:18.139329 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.139369 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:50:18.139483 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 22:50:18.139608 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"mutex_wait_us":32,"thread_start_us":457,"threads_started":1}
I20260809 22:50:18.140110 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.133236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:40217 (local address 127.23.131.65:41515)
0809 22:50:18.134092 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.134118 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:18.134318 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:18.134670 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:18.134674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:18.134698 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:18.135332 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:18.135342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.136363 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.136370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:18.137931 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:18.137942 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.139144 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.139151 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:18.139368 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.139395 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 22:50:18.139498 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 22:50:18.139621 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":82,"thread_start_us":420,"threads_started":1}
I20260809 22:50:18.141194 31093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6879ab58de415eabba729e932acd97" candidate_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd44a76ccbd4979a30697f423dd26ce" is_pre_election: true
I20260809 22:50:18.141472 31302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6879ab58de415eabba729e932acd97" candidate_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" is_pre_election: true
I20260809 22:50:18.141855 31093 raft_consensus.cc:2454] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a56d24cdf2a4aeb9230ca988ab4414a in term 0.
I20260809 22:50:18.141927 31302 raft_consensus.cc:2454] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a56d24cdf2a4aeb9230ca988ab4414a in term 0.
I20260809 22:50:18.142663 30749 leader_election.cc:302] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6a56d24cdf2a4aeb9230ca988ab4414a, 8cd44a76ccbd4979a30697f423dd26ce, 9fa9b54e4fb748a7ba05fa56be7c5639; no voters:
I20260809 22:50:18.143154 31417 raft_consensus.cc:2781] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:18.143390 31417 raft_consensus.cc:482] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:18.143543 31417 raft_consensus.cc:3037] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:18.146076 31417 raft_consensus.cc:504] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:18.146809 31417 leader_election.cc:288] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [CANDIDATE]: Term 1 election: Requested vote from peers 9fa9b54e4fb748a7ba05fa56be7c5639 (127.23.131.67:40217), 8cd44a76ccbd4979a30697f423dd26ce (127.23.131.66:38529)
I20260809 22:50:18.147352 31093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6879ab58de415eabba729e932acd97" candidate_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd44a76ccbd4979a30697f423dd26ce"
I20260809 22:50:18.147357 31302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd6879ab58de415eabba729e932acd97" candidate_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639"
I20260809 22:50:18.147558 31093 raft_consensus.cc:3037] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:18.147583 31302 raft_consensus.cc:3037] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:18.149791 31093 raft_consensus.cc:2454] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a56d24cdf2a4aeb9230ca988ab4414a in term 1.
I20260809 22:50:18.150223 31302 raft_consensus.cc:2454] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a56d24cdf2a4aeb9230ca988ab4414a in term 1.
I20260809 22:50:18.150276 30747 leader_election.cc:302] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a56d24cdf2a4aeb9230ca988ab4414a, 8cd44a76ccbd4979a30697f423dd26ce; no voters:
I20260809 22:50:18.150617 31417 raft_consensus.cc:2781] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:18.151129 31417 raft_consensus.cc:686] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 1 LEADER]: Becoming Leader. State: Replica: 6a56d24cdf2a4aeb9230ca988ab4414a, State: Running, Role: LEADER
I20260809 22:50:18.151682 31417 consensus_queue.cc:237] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } }
I20260809 22:50:18.156600 30629 catalog_manager.cc:5495] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a56d24cdf2a4aeb9230ca988ab4414a (127.23.131.65). New cstate: current_term: 1 leader_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a56d24cdf2a4aeb9230ca988ab4414a" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 44875 } health_report { overall_health: HEALTHY } } }
I20260809 22:50:18.233189 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.227446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49608 (local address 127.23.131.65:44875)
0809 22:50:18.227632 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:18.227636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:18.228178 (+ 542us) server_negotiation.cc:407] Connection header received
0809 22:50:18.228368 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:18.228372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:18.228476 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:18.228657 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:18.229046 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.229844 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.231233 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.231641 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.231736 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.232179 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:18.232717 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:18.232827 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:18.232918 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 22:50:18.232985 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 22:50:18.241818 31093 raft_consensus.cc:1261] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 1 FOLLOWER]: Refusing update from remote peer 6a56d24cdf2a4aeb9230ca988ab4414a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:18.241834 31302 raft_consensus.cc:1261] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 1 FOLLOWER]: Refusing update from remote peer 6a56d24cdf2a4aeb9230ca988ab4414a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:18.243052 31422 consensus_queue.cc:1035] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa9b54e4fb748a7ba05fa56be7c5639" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 40217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:18.243542 31417 consensus_queue.cc:1035] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd44a76ccbd4979a30697f423dd26ce" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:18.270327 30629 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:18.270566 30629 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:18.274196 30629 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4211888693674a069647b11d184f2d74: Sending DeleteTablet for 3 replicas of tablet bd6879ab58de415eabba729e932acd97
I20260809 22:50:18.275527 31269 tablet_service.cc:1514] Processing DeleteTablet for tablet bd6879ab58de415eabba729e932acd97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:18 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:38306
I20260809 22:50:18.275543 30835 tablet_service.cc:1514] Processing DeleteTablet for tablet bd6879ab58de415eabba729e932acd97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:18 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:49598
I20260809 22:50:18.277202 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 30723
I20260809 22:50:18.277539 31062 tablet_service.cc:1514] Processing DeleteTablet for tablet bd6879ab58de415eabba729e932acd97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:18 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:39294
Aug 09 22:50:18 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:18.301821 31451 tablet_replica.cc:330] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: stopping tablet replica
I20260809 22:50:18.303435 31451 raft_consensus.cc:2229] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:18.304533 31451 raft_consensus.cc:2258] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:18.305881 31450 tablet_replica.cc:330] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a: stopping tablet replica
I20260809 22:50:18.307753 31450 raft_consensus.cc:2229] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:18.310074 31451 ts_tablet_manager.cc:1905] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:18.310434 31449 tablet_replica.cc:330] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: stopping tablet replica
I20260809 22:50:18.310065 31450 raft_consensus.cc:2258] T bd6879ab58de415eabba729e932acd97 P 6a56d24cdf2a4aeb9230ca988ab4414a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:18.311056 31449 raft_consensus.cc:2229] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:18.311836 31449 raft_consensus.cc:2258] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:18.313891 31449 ts_tablet_manager.cc:1905] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:18.311165 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.278444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49618 (local address 127.23.131.65:44875)
0809 22:50:18.278631 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:18.278638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:18.287145 (+ 8507us) server_negotiation.cc:407] Connection header received
0809 22:50:18.287408 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:18.287416 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:18.287533 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:18.287629 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:18.289813 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.291336 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.293802 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.294716 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.294832 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.301598 (+ 6766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:18.301617 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:18.301639 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:18.301705 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:18.306282 (+ 4577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:18.307393 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:18.307403 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:18.307406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:18.307651 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:18.308194 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:18.308199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:18.308202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:18.308706 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:18.309024 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:18.309683 (+ 659us) server_negotiation.cc:299] Negotiation successful
0809 22:50:18.309974 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 22:50:18.316437 30935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:18.317983 31451 ts_tablet_manager.cc:1918] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:18.318253 31451 log.cc:1196] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/bd6879ab58de415eabba729e932acd97
I20260809 22:50:18.319183 31451 ts_tablet_manager.cc:1939] T bd6879ab58de415eabba729e932acd97 P 8cd44a76ccbd4979a30697f423dd26ce: Deleting consensus metadata
I20260809 22:50:18.322336 30606 catalog_manager.cc:4841] TS 8cd44a76ccbd4979a30697f423dd26ce (127.23.131.66:38529): tablet bd6879ab58de415eabba729e932acd97 (table test-table [id=a5ccbefaa5fd4b7ba299eff97843c2dd]) successfully deleted
I20260809 22:50:18.324975 31449 ts_tablet_manager.cc:1918] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:18.325150 31449 log.cc:1196] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/bd6879ab58de415eabba729e932acd97
I20260809 22:50:18.325660 31449 ts_tablet_manager.cc:1939] T bd6879ab58de415eabba729e932acd97 P 9fa9b54e4fb748a7ba05fa56be7c5639: Deleting consensus metadata
I20260809 22:50:18.327535 30607 catalog_manager.cc:4841] TS 9fa9b54e4fb748a7ba05fa56be7c5639 (127.23.131.67:40217): tablet bd6879ab58de415eabba729e932acd97 (table test-table [id=a5ccbefaa5fd4b7ba299eff97843c2dd]) successfully deleted
I20260809 22:50:18.424082 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 30723
I20260809 22:50:18.452378 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 30958
W20260809 22:50:18.452468 30606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:44875 (error 108)
I20260809 22:50:18.454592 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.453789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49626)
0809 22:50:18.454285 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.454400 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":287,"threads_started":1}
W20260809 22:50:18.454871 30606 catalog_manager.cc:4584] TS 6a56d24cdf2a4aeb9230ca988ab4414a (127.23.131.65:44875): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd6879ab58de415eabba729e932acd97: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Aug 09 22:50:18 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:50:18.468689 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.453315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39302 (local address 127.23.131.66:38529)
0809 22:50:18.453522 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:18.453527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:18.453706 (+ 179us) server_negotiation.cc:407] Connection header received
0809 22:50:18.453939 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:18.453943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:18.454019 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:18.454136 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:18.455662 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.456403 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.457665 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.458105 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.458251 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.462699 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:18.462716 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:18.462732 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:18.462768 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:18.465582 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:18.466273 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:18.466281 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:18.466283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:18.466484 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:18.466905 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:18.466910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:18.466914 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:18.467392 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:18.467724 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:18.468090 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 22:50:18.468332 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:50:18.469398 31157 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:18.508641 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.508061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49638)
0809 22:50:18.508323 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.508460 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260809 22:50:18.509976 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.509513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49650)
0809 22:50:18.509696 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.509784 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 22:50:18.562789 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 30958
I20260809 22:50:18.571403 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.570814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49658)
0809 22:50:18.571062 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.571173 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 22:50:18.572834 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.572310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49672)
0809 22:50:18.572526 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.572640 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 22:50:18.592164 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 31173
Aug 09 22:50:18 dist-test-slave-92m1 krb5kdc[30552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:50:18.608719 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.593177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38320 (local address 127.23.131.67:40217)
0809 22:50:18.593370 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:18.593378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:18.593416 (+ 38us) server_negotiation.cc:407] Connection header received
0809 22:50:18.593650 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:18.593655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:18.593746 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:18.593867 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:18.595171 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.595969 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.597253 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:18.597707 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:18.597850 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:18.602523 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:18.602539 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:18.602556 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:18.602597 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:18.605712 (+ 3115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:18.606384 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:18.606392 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:18.606394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:18.606555 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:18.607015 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:18.607020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:18.607023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:18.607613 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:18.607866 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:18.608207 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 22:50:18.608415 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:50:18.609452 31368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:18.653578 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.652970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49684)
0809 22:50:18.653238 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.653346 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 22:50:18.654836 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.654386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49686)
0809 22:50:18.654600 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.654677 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 22:50:18.702004 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 31173
I20260809 22:50:18.726708 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 30581
I20260809 22:50:18.728014 30674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:18.843108 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:18.842378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:44875 (local address 127.0.0.1:49696)
0809 22:50:18.842760 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:18.842921 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:44875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260809 22:50:18.843202 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 30581
2026-08-09T22:50:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5064 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T22:50:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:18Z Disabled control of system clock
I20260809 22:50:18.937567 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:43745
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:32795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:43745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 22:50:19.288841 31466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:19.289314 31466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:19.289515 31466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:19.297420 31466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:19.297533 31466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:19.297574 31466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:19.297626 31466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:19.297672 31466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:19.307284 31466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:32795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:43745
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:43745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:19.308622 31466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:19.310410 31466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:19.323043 31476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:19.323086 31475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:19.323251 31480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:19.324304 31466 server_base.cc:1034] running on GCE node
I20260809 22:50:19.325120 31466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:19.326598 31466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:19.327844 31466 hybrid_clock.cc:648] HybridClock initialized: now 1786315819327795 us; error 63 us; skew 500 ppm
I20260809 22:50:19.328234 31466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:19.330701 31466 webserver.cc:460] Webserver started at http://127.23.131.126:34757/ using document root <none> and password file <none>
I20260809 22:50:19.331523 31466 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:19.331655 31466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:19.331993 31466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:19.335014 31466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "b3f4dec4f2df4debacf471bbf5b98835"
format_stamp: "Formatted at 2026-08-09 22:50:19 on dist-test-slave-92m1"
server_key: "22e20719e3c1445c11202552c653a759"
server_key_iv: "a2600335cecfe655e572dbabcb10ace0"
server_key_version: "encryptionkey@0"
I20260809 22:50:19.335903 31466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "b3f4dec4f2df4debacf471bbf5b98835"
format_stamp: "Formatted at 2026-08-09 22:50:19 on dist-test-slave-92m1"
server_key: "22e20719e3c1445c11202552c653a759"
server_key_iv: "a2600335cecfe655e572dbabcb10ace0"
server_key_version: "encryptionkey@0"
I20260809 22:50:19.341246 31466 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 22:50:19.344846 31487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:19.346123 31466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:50:19.346308 31466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "b3f4dec4f2df4debacf471bbf5b98835"
format_stamp: "Formatted at 2026-08-09 22:50:19 on dist-test-slave-92m1"
server_key: "22e20719e3c1445c11202552c653a759"
server_key_iv: "a2600335cecfe655e572dbabcb10ace0"
server_key_version: "encryptionkey@0"
I20260809 22:50:19.346561 31466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:19.352674 31466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:19.353518 31466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:19.353839 31466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:19.373030 31466 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:43745
I20260809 22:50:19.373080 31561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:43745 every 8 connection(s)
I20260809 22:50:19.374522 31466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:19.378572 31562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:19.385156 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 31466
I20260809 22:50:19.385387 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:19.386300 24077 external_mini_cluster.cc:1428] Setting key 08c82d33c9eb6e763b0a0f78ec798d73
I20260809 22:50:19.390776 31562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835: Bootstrap starting.
I20260809 22:50:19.394272 31562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:19.395488 31562 log.cc:824] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:19.395584 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:19.388727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35478 (local address 127.23.131.126:43745)
0809 22:50:19.389798 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:19.389809 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:19.389853 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:50:19.391816 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:19.391839 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:19.392255 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:19.392698 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:19.393827 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:19.393834 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:19.393846 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:19.393861 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:19.393923 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:19.393939 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:19.394137 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:19.394297 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 22:50:19.394592 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":367,"threads_started":1}
I20260809 22:50:19.398656 31562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835: No bootstrap required, opened a new log
I20260809 22:50:19.406301 31562 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f4dec4f2df4debacf471bbf5b98835" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43745 } }
I20260809 22:50:19.406734 31562 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:19.406850 31562 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f4dec4f2df4debacf471bbf5b98835, State: Initialized, Role: FOLLOWER
I20260809 22:50:19.407547 31562 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f4dec4f2df4debacf471bbf5b98835" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43745 } }
I20260809 22:50:19.407887 31562 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:19.408043 31562 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:19.408241 31562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:19.410619 31562 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f4dec4f2df4debacf471bbf5b98835" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43745 } }
I20260809 22:50:19.411362 31562 leader_election.cc:302] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3f4dec4f2df4debacf471bbf5b98835; no voters:
I20260809 22:50:19.412160 31562 leader_election.cc:288] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:19.412312 31571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:19.414155 31571 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [term 1 LEADER]: Becoming Leader. State: Replica: b3f4dec4f2df4debacf471bbf5b98835, State: Running, Role: LEADER
I20260809 22:50:19.414826 31562 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:19.414829 31571 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f4dec4f2df4debacf471bbf5b98835" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43745 } }
I20260809 22:50:19.418211 31576 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3f4dec4f2df4debacf471bbf5b98835. Latest consensus state: current_term: 1 leader_uuid: "b3f4dec4f2df4debacf471bbf5b98835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f4dec4f2df4debacf471bbf5b98835" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43745 } } }
I20260809 22:50:19.418236 31573 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3f4dec4f2df4debacf471bbf5b98835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f4dec4f2df4debacf471bbf5b98835" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 43745 } } }
I20260809 22:50:19.418675 31573 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:19.418677 31576 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:19.420475 31584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:19.425540 31584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:19.436028 31584 catalog_manager.cc:1347] Generated new cluster ID: 78a272e5205d4def8680c8a16b58ea8f
I20260809 22:50:19.436165 31584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:19.451251 31584 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:19.451731 31584 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:19.457711 31584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835: Generated new TSK 0
I20260809 22:50:19.458535 31584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:50:19.471949 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43745
--builtin_ntp_servers=127.23.131.84:32795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 22:50:19.845703 31609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:19.845997 31609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:19.846179 31609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:19.854009 31609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:19.854175 31609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:19.854400 31609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:19.863799 31609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:32795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43745
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:19.865192 31609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:19.867079 31609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:19.880867 31615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:19.880815 31619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:19.881326 31616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:19.882048 31609 server_base.cc:1034] running on GCE node
I20260809 22:50:19.882742 31609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:19.883890 31609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:19.885129 31609 hybrid_clock.cc:648] HybridClock initialized: now 1786315819885070 us; error 58 us; skew 500 ppm
I20260809 22:50:19.885468 31609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:19.888000 31609 webserver.cc:460] Webserver started at http://127.23.131.65:39119/ using document root <none> and password file <none>
I20260809 22:50:19.888746 31609 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:19.888882 31609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:19.889237 31609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:19.892366 31609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "a9be51b26e534fe9b7ba772edd327f8b"
format_stamp: "Formatted at 2026-08-09 22:50:19 on dist-test-slave-92m1"
server_key: "4c27a0aa7ecf93aa503bbfa993b21c46"
server_key_iv: "e66f147d5853920733344ac3c04527d5"
server_key_version: "encryptionkey@0"
I20260809 22:50:19.893249 31609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "a9be51b26e534fe9b7ba772edd327f8b"
format_stamp: "Formatted at 2026-08-09 22:50:19 on dist-test-slave-92m1"
server_key: "4c27a0aa7ecf93aa503bbfa993b21c46"
server_key_iv: "e66f147d5853920733344ac3c04527d5"
server_key_version: "encryptionkey@0"
I20260809 22:50:19.899456 31609 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 22:50:19.903167 31633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:19.904811 31609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:19.905056 31609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "a9be51b26e534fe9b7ba772edd327f8b"
format_stamp: "Formatted at 2026-08-09 22:50:19 on dist-test-slave-92m1"
server_key: "4c27a0aa7ecf93aa503bbfa993b21c46"
server_key_iv: "e66f147d5853920733344ac3c04527d5"
server_key_version: "encryptionkey@0"
I20260809 22:50:19.905349 31609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:19.911772 31609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:19.912689 31609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:19.912997 31609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:19.914014 31609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:19.915732 31609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:19.915875 31609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:19.916016 31609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:19.916112 31609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:19.953166 31609 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:46417
I20260809 22:50:19.953267 31819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:46417 every 8 connection(s)
I20260809 22:50:19.954671 31609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:19.956079 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 31609
I20260809 22:50:19.956281 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:19.957170 24077 external_mini_cluster.cc:1428] Setting key 660d8a8054e5b9807a119583b998366c
I20260809 22:50:19.960636 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43745
--builtin_ntp_servers=127.23.131.84:32795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 22:50:19.964423 31824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:19.957809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:50205 (local address 127.23.131.126:43745)
0809 22:50:19.958427 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:19.958438 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:19.959950 (+ 1512us) server_negotiation.cc:407] Connection header received
0809 22:50:19.961842 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:19.961851 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:19.961937 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:19.962084 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:19.963465 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:19.963474 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:19.963483 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:19.963510 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:19.963577 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:19.963597 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:19.963740 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:19.963910 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 22:50:19.964003 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":350,"threads_started":1}
I20260809 22:50:19.965142 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:19.958606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:43745 (local address 127.23.131.65:50205)
0809 22:50:19.959746 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:19.959802 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:19.961563 (+ 1761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:19.962268 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:19.962276 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:19.962363 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:19.963105 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:19.963107 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:19.963144 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:19.963289 (+ 145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:19.963705 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:19.963713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:19.963719 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:50:19.963968 (+ 249us) client_negotiation.cc:240] Negotiation successful
0809 22:50:19.964177 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":352,"threads_started":1}
I20260809 22:50:19.966816 31820 heartbeater.cc:347] Connected to a master server at 127.23.131.126:43745
I20260809 22:50:19.967161 31820 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:19.967804 31820 heartbeater.cc:511] Master 127.23.131.126:43745 requested a full tablet report, sending...
I20260809 22:50:19.970026 31512 ts_manager.cc:194] Registered new tserver with Master: a9be51b26e534fe9b7ba772edd327f8b (127.23.131.65:46417)
W20260809 22:50:20.310009 31826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:20.310312 31826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:20.310446 31826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:20.318055 31826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:20.318172 31826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:20.318380 31826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:20.328579 31826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:32795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43745
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:20.329921 31826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:20.331857 31826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:20.345271 31833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:20.345438 31837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:20.345465 31834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:20.346796 31826 server_base.cc:1034] running on GCE node
I20260809 22:50:20.347570 31826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:20.348604 31826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:20.349810 31826 hybrid_clock.cc:648] HybridClock initialized: now 1786315820349767 us; error 41 us; skew 500 ppm
I20260809 22:50:20.350185 31826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:20.352831 31826 webserver.cc:460] Webserver started at http://127.23.131.66:46027/ using document root <none> and password file <none>
I20260809 22:50:20.353606 31826 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:20.353736 31826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:20.354159 31826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:20.357357 31826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "47999c7c469742acbe511ab90579aafd"
format_stamp: "Formatted at 2026-08-09 22:50:20 on dist-test-slave-92m1"
server_key: "56bdf26cb41a99dbbc463839350b693c"
server_key_iv: "b77548e97e28be8e2a29d9d43f671819"
server_key_version: "encryptionkey@0"
I20260809 22:50:20.358321 31826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "47999c7c469742acbe511ab90579aafd"
format_stamp: "Formatted at 2026-08-09 22:50:20 on dist-test-slave-92m1"
server_key: "56bdf26cb41a99dbbc463839350b693c"
server_key_iv: "b77548e97e28be8e2a29d9d43f671819"
server_key_version: "encryptionkey@0"
I20260809 22:50:20.364117 31826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:50:20.367729 31844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:20.369107 31826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 22:50:20.369270 31826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "47999c7c469742acbe511ab90579aafd"
format_stamp: "Formatted at 2026-08-09 22:50:20 on dist-test-slave-92m1"
server_key: "56bdf26cb41a99dbbc463839350b693c"
server_key_iv: "b77548e97e28be8e2a29d9d43f671819"
server_key_version: "encryptionkey@0"
I20260809 22:50:20.369571 31826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:20.375765 31826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:20.376575 31826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:20.376864 31826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:20.377914 31826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:20.379480 31826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:20.379624 31826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:20.379760 31826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:20.379859 31826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:20.419113 31826 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:40751
I20260809 22:50:20.419193 32026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:40751 every 8 connection(s)
I20260809 22:50:20.420547 31826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:20.429014 31824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.423342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:37513 (local address 127.23.131.126:43745)
0809 22:50:20.423545 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:20.423550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:20.424884 (+ 1334us) server_negotiation.cc:407] Connection header received
0809 22:50:20.426613 (+ 1729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:20.426619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:20.426700 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:20.426860 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:20.428232 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:20.428237 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:20.428242 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:20.428261 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:20.428304 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:20.428316 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:20.428456 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:20.428647 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 22:50:20.428721 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:50:20.429868 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.423834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:43745 (local address 127.23.131.66:37513)
0809 22:50:20.424731 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:20.424771 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:20.426343 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:20.427091 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:20.427100 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:20.427179 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:20.427952 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:20.427955 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:20.427990 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:20.428070 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:20.428424 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:20.428436 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:20.428443 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 22:50:20.428728 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 22:50:20.428964 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":295,"threads_started":1}
I20260809 22:50:20.430897 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 31826
I20260809 22:50:20.431105 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:20.431461 32028 heartbeater.cc:347] Connected to a master server at 127.23.131.126:43745
I20260809 22:50:20.431695 24077 external_mini_cluster.cc:1428] Setting key 7c97d8469e30b3f1966c12131f214316
I20260809 22:50:20.431784 32028 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:20.432385 32028 heartbeater.cc:511] Master 127.23.131.126:43745 requested a full tablet report, sending...
I20260809 22:50:20.433931 31512 ts_manager.cc:194] Registered new tserver with Master: 47999c7c469742acbe511ab90579aafd (127.23.131.66:40751)
I20260809 22:50:20.434715 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43745
--builtin_ntp_servers=127.23.131.84:32795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 22:50:20.785194 32032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:20.785558 32032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:20.785737 32032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:20.793390 32032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:20.793560 32032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:20.793756 32032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:20.803606 32032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:32795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:43745
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:20.805035 32032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:20.806931 32032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:20.822481 32042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:20.822458 32044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:20.822834 32041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:20.823340 32032 server_base.cc:1034] running on GCE node
I20260809 22:50:20.824007 32032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:20.825104 32032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:20.826342 32032 hybrid_clock.cc:648] HybridClock initialized: now 1786315820826275 us; error 64 us; skew 500 ppm
I20260809 22:50:20.826714 32032 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:20.829280 32032 webserver.cc:460] Webserver started at http://127.23.131.67:43199/ using document root <none> and password file <none>
I20260809 22:50:20.830039 32032 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:20.830179 32032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:20.830535 32032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:20.833611 32032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "c321eb6005594291a135bbc0d04761b1"
format_stamp: "Formatted at 2026-08-09 22:50:20 on dist-test-slave-92m1"
server_key: "5132fa295bbd386f40287c13e56c7516"
server_key_iv: "57f00aa41f13ed240a52f2bc060a9b68"
server_key_version: "encryptionkey@0"
I20260809 22:50:20.834417 32032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "c321eb6005594291a135bbc0d04761b1"
format_stamp: "Formatted at 2026-08-09 22:50:20 on dist-test-slave-92m1"
server_key: "5132fa295bbd386f40287c13e56c7516"
server_key_iv: "57f00aa41f13ed240a52f2bc060a9b68"
server_key_version: "encryptionkey@0"
I20260809 22:50:20.839658 32032 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 22:50:20.843119 32055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:20.844449 32032 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:20.844637 32032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "c321eb6005594291a135bbc0d04761b1"
format_stamp: "Formatted at 2026-08-09 22:50:20 on dist-test-slave-92m1"
server_key: "5132fa295bbd386f40287c13e56c7516"
server_key_iv: "57f00aa41f13ed240a52f2bc060a9b68"
server_key_version: "encryptionkey@0"
I20260809 22:50:20.844866 32032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:20.850719 32032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:20.851593 32032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:20.851871 32032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:20.852843 32032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:20.854363 32032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:20.854493 32032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:20.854640 32032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:20.854733 32032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:20.890635 32032 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:44437
I20260809 22:50:20.890727 32237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:44437 every 8 connection(s)
I20260809 22:50:20.892102 32032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:20.893247 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 32032
I20260809 22:50:20.893427 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:20.893981 24077 external_mini_cluster.cc:1428] Setting key 7b18d003719712456a025639cf465f3c
I20260809 22:50:20.901474 31824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.894982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:52601 (local address 127.23.131.126:43745)
0809 22:50:20.895196 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:20.895220 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:20.897516 (+ 2296us) server_negotiation.cc:407] Connection header received
0809 22:50:20.899145 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:20.899150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:20.899275 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:20.899386 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:20.900746 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:20.900751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:20.900754 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:20.900774 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:20.900813 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:20.900826 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:20.900945 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:20.901134 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 22:50:20.901203 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 22:50:20.902309 32246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.895680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:43745 (local address 127.23.131.67:52601)
0809 22:50:20.897348 (+ 1668us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:20.897388 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:20.898893 (+ 1505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:20.899682 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:20.899693 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:20.899790 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:20.900437 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:20.900439 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:20.900484 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:20.900565 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:20.900936 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:20.900945 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:20.900950 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 22:50:20.901158 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 22:50:20.901349 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1246,"thread_start_us":371,"threads_started":1}
I20260809 22:50:20.903708 32238 heartbeater.cc:347] Connected to a master server at 127.23.131.126:43745
I20260809 22:50:20.904055 32238 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:20.904700 32238 heartbeater.cc:511] Master 127.23.131.126:43745 requested a full tablet report, sending...
I20260809 22:50:20.906152 31512 ts_manager.cc:194] Registered new tserver with Master: c321eb6005594291a135bbc0d04761b1 (127.23.131.67:44437)
I20260809 22:50:20.909720 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:50:20.917757 31824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.914818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35492 (local address 127.23.131.126:43745)
0809 22:50:20.915052 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:20.915061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:20.915697 (+ 636us) server_negotiation.cc:407] Connection header received
0809 22:50:20.915909 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:20.915917 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:20.915983 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:20.916093 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:20.917062 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:20.917068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:20.917073 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:20.917093 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:20.917137 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:20.917150 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:20.917282 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:20.917402 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 22:50:20.917479 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:50:20.922528 31512 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:20.929719 31512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:20.948581 32266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.942621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55554)
0809 22:50:20.944148 (+ 1527us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:20.944205 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:20.944343 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:20.945128 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:20.945137 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:20.945223 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:20.946980 (+ 1757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:20.946986 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:20.947020 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:20.947121 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:20.947674 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:20.947685 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:20.947692 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 22:50:20.947863 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 22:50:20.947983 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1242,"thread_start_us":1075,"threads_started":1}
I20260809 22:50:20.948757 32267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.942855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55554 (local address 127.23.131.65:46417)
0809 22:50:20.943706 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:20.943718 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:20.944510 (+ 792us) server_negotiation.cc:407] Connection header received
0809 22:50:20.944596 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:20.944606 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:20.944870 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:20.945074 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:20.947336 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:20.947345 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:20.947360 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:20.947387 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:20.947447 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:20.947469 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:20.947580 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:20.947899 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 22:50:20.948032 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":528,"threads_started":1}
I20260809 22:50:20.951025 32274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.944712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44437 (local address 127.0.0.1:47882)
0809 22:50:20.946801 (+ 2089us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:20.946825 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:20.946931 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:20.948741 (+ 1810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:20.948747 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:20.948777 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:20.949693 (+ 916us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:20.949697 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:20.949804 (+ 107us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:20.949856 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:20.950290 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:20.950297 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:20.950302 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 22:50:20.950439 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 22:50:20.950499 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1947,"thread_start_us":2128,"threads_started":1}
I20260809 22:50:20.951069 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.945426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.23.131.67:44437)
0809 22:50:20.947519 (+ 2093us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:20.947525 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:20.947551 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:50:20.947608 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:20.947612 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:20.947766 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:20.947948 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:20.950044 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:20.950055 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:20.950068 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:20.950086 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:20.950150 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:20.950172 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:20.950364 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:20.950431 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 22:50:20.950547 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1940,"thread_start_us":1640,"threads_started":1}
I20260809 22:50:20.951488 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.943077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:40751 (local address 127.0.0.1:39988)
0809 22:50:20.944807 (+ 1730us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:20.944845 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:20.944945 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:20.948063 (+ 3118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:20.948068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:20.948092 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:20.948808 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:20.948811 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:20.948826 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:20.948892 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:20.950625 (+ 1733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:20.950630 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:20.950635 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 22:50:20.950771 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 22:50:20.950832 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1590,"thread_start_us":1378,"threads_started":1}
I20260809 22:50:20.952179 32272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:20.943808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39988 (local address 127.23.131.66:40751)
0809 22:50:20.947478 (+ 3670us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:20.947487 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:20.947519 (+ 32us) server_negotiation.cc:407] Connection header received
0809 22:50:20.947592 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:20.947602 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:20.947817 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:20.948551 (+ 734us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:20.950368 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:20.950377 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:20.950390 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:20.950408 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:20.950463 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:20.950488 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:20.951757 (+ 1269us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:20.951823 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 22:50:20.951933 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3487,"thread_start_us":3333,"threads_started":1}
I20260809 22:50:20.955000 32129 tablet_service.cc:1467] Processing CreateTablet for tablet b340d86452db4edc8fa07f39c5a93e20 (DEFAULT_TABLE table=test-table [id=79ec53a1963f4f52a2bc1cef14ea47f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:20.955456 31916 tablet_service.cc:1467] Processing CreateTablet for tablet b340d86452db4edc8fa07f39c5a93e20 (DEFAULT_TABLE table=test-table [id=79ec53a1963f4f52a2bc1cef14ea47f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:20.956483 32129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b340d86452db4edc8fa07f39c5a93e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:20.956664 31916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b340d86452db4edc8fa07f39c5a93e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:20.959475 31711 tablet_service.cc:1467] Processing CreateTablet for tablet b340d86452db4edc8fa07f39c5a93e20 (DEFAULT_TABLE table=test-table [id=79ec53a1963f4f52a2bc1cef14ea47f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:20.960726 31711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b340d86452db4edc8fa07f39c5a93e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:20.972790 31820 heartbeater.cc:503] Master 127.23.131.126:43745 was elected leader, sending a full tablet report...
I20260809 22:50:20.973778 32277 tablet_bootstrap.cc:492] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Bootstrap starting.
I20260809 22:50:20.977031 32280 tablet_bootstrap.cc:492] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Bootstrap starting.
I20260809 22:50:20.978106 32279 tablet_bootstrap.cc:492] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b: Bootstrap starting.
I20260809 22:50:20.978711 32277 tablet_bootstrap.cc:654] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:20.980108 32277 log.cc:824] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:20.981145 32280 tablet_bootstrap.cc:654] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:20.981213 32279 tablet_bootstrap.cc:654] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:20.982347 32279 log.cc:824] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:20.982856 32280 log.cc:824] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:20.983973 32277 tablet_bootstrap.cc:492] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: No bootstrap required, opened a new log
I20260809 22:50:20.984254 32277 ts_tablet_manager.cc:1397] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260809 22:50:20.985502 32279 tablet_bootstrap.cc:492] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b: No bootstrap required, opened a new log
I20260809 22:50:20.985553 32280 tablet_bootstrap.cc:492] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: No bootstrap required, opened a new log
I20260809 22:50:20.985771 32279 ts_tablet_manager.cc:1397] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260809 22:50:20.985857 32280 ts_tablet_manager.cc:1397] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260809 22:50:20.993264 32280 raft_consensus.cc:348] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:20.993656 32280 raft_consensus.cc:374] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:20.993762 32280 raft_consensus.cc:729] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47999c7c469742acbe511ab90579aafd, State: Initialized, Role: FOLLOWER
I20260809 22:50:20.994405 32280 consensus_queue.cc:260] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:20.995018 32277 raft_consensus.cc:348] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:20.995553 32277 raft_consensus.cc:374] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:20.995600 32028 heartbeater.cc:503] Master 127.23.131.126:43745 was elected leader, sending a full tablet report...
I20260809 22:50:20.995725 32277 raft_consensus.cc:729] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c321eb6005594291a135bbc0d04761b1, State: Initialized, Role: FOLLOWER
I20260809 22:50:20.996312 32280 ts_tablet_manager.cc:1428] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Time spent starting tablet: real 0.010s user 0.005s sys 0.005s
I20260809 22:50:20.996467 32277 consensus_queue.cc:260] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:20.996703 32279 raft_consensus.cc:348] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:20.997167 32279 raft_consensus.cc:374] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:20.997354 32279 raft_consensus.cc:729] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9be51b26e534fe9b7ba772edd327f8b, State: Initialized, Role: FOLLOWER
I20260809 22:50:20.998073 32279 consensus_queue.cc:260] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:21.003821 32238 heartbeater.cc:503] Master 127.23.131.126:43745 was elected leader, sending a full tablet report...
I20260809 22:50:21.005092 32277 ts_tablet_manager.cc:1428] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Time spent starting tablet: real 0.021s user 0.015s sys 0.004s
I20260809 22:50:21.006225 32279 ts_tablet_manager.cc:1428] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b: Time spent starting tablet: real 0.020s user 0.009s sys 0.011s
I20260809 22:50:21.043658 32291 raft_consensus.cc:482] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:21.044009 32291 raft_consensus.cc:504] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:21.045799 32291 leader_election.cc:288] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47999c7c469742acbe511ab90579aafd (127.23.131.66:40751), c321eb6005594291a135bbc0d04761b1 (127.23.131.67:44437)
I20260809 22:50:21.049614 32272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.046381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:42475 (local address 127.23.131.66:40751)
0809 22:50:21.046739 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:21.046746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:21.047262 (+ 516us) server_negotiation.cc:407] Connection header received
0809 22:50:21.047411 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:21.047415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:21.047472 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:21.047580 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:21.048913 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:21.048919 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:21.048924 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:21.048953 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:21.048989 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:21.049004 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:21.049127 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:21.049273 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 22:50:21.049344 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205}
I20260809 22:50:21.049692 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.046408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:55825 (local address 127.23.131.67:44437)
0809 22:50:21.046643 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:21.046651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:21.047158 (+ 507us) server_negotiation.cc:407] Connection header received
0809 22:50:21.047393 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:21.047398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:21.047477 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:21.047580 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:21.048913 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:21.048919 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:21.048924 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:21.048945 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:21.048988 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:21.049004 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:21.049135 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:21.049368 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 22:50:21.049428 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 22:50:21.049991 32296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.046262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:40751 (local address 127.23.131.65:42475)
0809 22:50:21.047144 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.047161 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:21.047289 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:21.047638 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:21.047642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:21.047666 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:21.048704 (+ 1038us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:21.048707 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:21.048718 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:21.048747 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:21.049121 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:21.049126 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:21.049132 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:50:21.049367 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 22:50:21.049444 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":24,"thread_start_us":539,"threads_started":1}
I20260809 22:50:21.050251 32294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.046114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44437 (local address 127.23.131.65:55825)
0809 22:50:21.047018 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.047044 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:21.047187 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:21.047635 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:21.047640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:21.047666 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:21.048664 (+ 998us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:50:21.048670 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:21.048691 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:50:21.048747 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:21.049121 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:21.049127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:21.049132 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 22:50:21.049355 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 22:50:21.049430 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"thread_start_us":502,"threads_started":1}
I20260809 22:50:21.051260 32162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b340d86452db4edc8fa07f39c5a93e20" candidate_uuid: "a9be51b26e534fe9b7ba772edd327f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c321eb6005594291a135bbc0d04761b1" is_pre_election: true
I20260809 22:50:21.051260 31953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b340d86452db4edc8fa07f39c5a93e20" candidate_uuid: "a9be51b26e534fe9b7ba772edd327f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47999c7c469742acbe511ab90579aafd" is_pre_election: true
I20260809 22:50:21.051869 32162 raft_consensus.cc:2454] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9be51b26e534fe9b7ba772edd327f8b in term 0.
I20260809 22:50:21.051869 31953 raft_consensus.cc:2454] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9be51b26e534fe9b7ba772edd327f8b in term 0.
I20260809 22:50:21.052601 31635 leader_election.cc:302] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9be51b26e534fe9b7ba772edd327f8b, c321eb6005594291a135bbc0d04761b1; no voters:
I20260809 22:50:21.053033 32291 raft_consensus.cc:2781] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:21.053182 32291 raft_consensus.cc:482] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:21.053313 32291 raft_consensus.cc:3037] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:21.055675 32291 raft_consensus.cc:504] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:21.056327 32291 leader_election.cc:288] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [CANDIDATE]: Term 1 election: Requested vote from peers 47999c7c469742acbe511ab90579aafd (127.23.131.66:40751), c321eb6005594291a135bbc0d04761b1 (127.23.131.67:44437)
I20260809 22:50:21.056738 31953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b340d86452db4edc8fa07f39c5a93e20" candidate_uuid: "a9be51b26e534fe9b7ba772edd327f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47999c7c469742acbe511ab90579aafd"
I20260809 22:50:21.056872 32162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b340d86452db4edc8fa07f39c5a93e20" candidate_uuid: "a9be51b26e534fe9b7ba772edd327f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c321eb6005594291a135bbc0d04761b1"
I20260809 22:50:21.056969 31953 raft_consensus.cc:3037] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:21.057097 32162 raft_consensus.cc:3037] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:21.060456 31953 raft_consensus.cc:2454] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9be51b26e534fe9b7ba772edd327f8b in term 1.
I20260809 22:50:21.060444 32162 raft_consensus.cc:2454] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9be51b26e534fe9b7ba772edd327f8b in term 1.
I20260809 22:50:21.060891 31637 leader_election.cc:302] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47999c7c469742acbe511ab90579aafd, a9be51b26e534fe9b7ba772edd327f8b; no voters:
I20260809 22:50:21.061223 32291 raft_consensus.cc:2781] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:21.061676 32291 raft_consensus.cc:686] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [term 1 LEADER]: Becoming Leader. State: Replica: a9be51b26e534fe9b7ba772edd327f8b, State: Running, Role: LEADER
I20260809 22:50:21.062160 32291 consensus_queue.cc:237] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } }
I20260809 22:50:21.066917 31511 catalog_manager.cc:5495] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b reported cstate change: term changed from 0 to 1, leader changed from <none> to a9be51b26e534fe9b7ba772edd327f8b (127.23.131.65). New cstate: current_term: 1 leader_uuid: "a9be51b26e534fe9b7ba772edd327f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9be51b26e534fe9b7ba772edd327f8b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 46417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 } health_report { overall_health: UNKNOWN } } }
I20260809 22:50:21.106542 32267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.104227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55560 (local address 127.23.131.65:46417)
0809 22:50:21.104408 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:21.104412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:21.104600 (+ 188us) server_negotiation.cc:407] Connection header received
0809 22:50:21.104793 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:21.104797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:21.104880 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:21.104967 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:21.105960 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:21.105965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:21.105968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:21.105981 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:21.106009 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:21.106020 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:21.106110 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:21.106265 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 22:50:21.106314 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 22:50:21.115620 31953 raft_consensus.cc:1261] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 1 FOLLOWER]: Refusing update from remote peer a9be51b26e534fe9b7ba772edd327f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:21.115618 32162 raft_consensus.cc:1261] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 1 FOLLOWER]: Refusing update from remote peer a9be51b26e534fe9b7ba772edd327f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:21.116732 32297 consensus_queue.cc:1035] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c321eb6005594291a135bbc0d04761b1" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:21.117121 32291 consensus_queue.cc:1035] T b340d86452db4edc8fa07f39c5a93e20 P a9be51b26e534fe9b7ba772edd327f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "47999c7c469742acbe511ab90579aafd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 40751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:21.141907 31511 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:21.142189 31511 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:21.146142 31511 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b3f4dec4f2df4debacf471bbf5b98835: Sending DeleteTablet for 3 replicas of tablet b340d86452db4edc8fa07f39c5a93e20
I20260809 22:50:21.147269 31711 tablet_service.cc:1514] Processing DeleteTablet for tablet b340d86452db4edc8fa07f39c5a93e20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:21 UTC) from {username='slave'} at 127.0.0.1:55554
I20260809 22:50:21.147729 32129 tablet_service.cc:1514] Processing DeleteTablet for tablet b340d86452db4edc8fa07f39c5a93e20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:21 UTC) from {username='slave'} at 127.0.0.1:47882
I20260809 22:50:21.148980 31916 tablet_service.cc:1514] Processing DeleteTablet for tablet b340d86452db4edc8fa07f39c5a93e20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:21 UTC) from {username='slave'} at 127.0.0.1:39988
I20260809 22:50:21.152814 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 31609
I20260809 22:50:21.162771 32267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.154286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55566 (local address 127.23.131.65:46417)
0809 22:50:21.154514 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:21.154522 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:21.159744 (+ 5222us) server_negotiation.cc:407] Connection header received
0809 22:50:21.160095 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:21.160103 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:21.160184 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:21.160268 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:21.161714 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:21.161723 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:21.161728 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:21.161758 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:21.161806 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:21.161827 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:21.161954 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:21.162259 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 22:50:21.162337 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:50:21.164000 32317 tablet_replica.cc:330] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: stopping tablet replica
I20260809 22:50:21.164242 31811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:21.164739 32318 tablet_replica.cc:330] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: stopping tablet replica
I20260809 22:50:21.165197 32317 raft_consensus.cc:2229] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:21.165321 32318 raft_consensus.cc:2229] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:21.165917 32317 raft_consensus.cc:2258] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:21.166196 32318 raft_consensus.cc:2258] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:21.168895 32318 ts_tablet_manager.cc:1905] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:21.169000 32317 ts_tablet_manager.cc:1905] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:21.177505 32317 ts_tablet_manager.cc:1918] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:21.177683 32317 log.cc:1196] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/b340d86452db4edc8fa07f39c5a93e20
I20260809 22:50:21.177707 32318 ts_tablet_manager.cc:1918] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:21.177927 32318 log.cc:1196] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/b340d86452db4edc8fa07f39c5a93e20
I20260809 22:50:21.178249 32317 ts_tablet_manager.cc:1939] T b340d86452db4edc8fa07f39c5a93e20 P c321eb6005594291a135bbc0d04761b1: Deleting consensus metadata
I20260809 22:50:21.178426 32318 ts_tablet_manager.cc:1939] T b340d86452db4edc8fa07f39c5a93e20 P 47999c7c469742acbe511ab90579aafd: Deleting consensus metadata
I20260809 22:50:21.180032 31493 catalog_manager.cc:4841] TS 47999c7c469742acbe511ab90579aafd (127.23.131.66:40751): tablet b340d86452db4edc8fa07f39c5a93e20 (table test-table [id=79ec53a1963f4f52a2bc1cef14ea47f3]) successfully deleted
I20260809 22:50:21.180003 31491 catalog_manager.cc:4841] TS c321eb6005594291a135bbc0d04761b1 (127.23.131.67:44437): tablet b340d86452db4edc8fa07f39c5a93e20 (table test-table [id=79ec53a1963f4f52a2bc1cef14ea47f3]) successfully deleted
I20260809 22:50:21.269932 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 31609
I20260809 22:50:21.300127 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 31826
W20260809 22:50:21.300189 31492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:46417 (error 108)
I20260809 22:50:21.302184 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.301667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55572)
0809 22:50:21.301864 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.302023 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 22:50:21.302487 31492 catalog_manager.cc:4584] TS a9be51b26e534fe9b7ba772edd327f8b (127.23.131.65:46417): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b340d86452db4edc8fa07f39c5a93e20: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
I20260809 22:50:21.303592 32272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.301104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.23.131.66:40751)
0809 22:50:21.301299 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:21.301304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:21.301417 (+ 113us) server_negotiation.cc:407] Connection header received
0809 22:50:21.301658 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:21.301662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:21.301801 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:21.301913 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:21.302893 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:21.302899 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:21.302904 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:21.302929 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:21.302967 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:21.302979 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:21.303131 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:21.303246 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 22:50:21.303310 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:50:21.304293 32020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:21.356297 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.355713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55588)
0809 22:50:21.355944 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.356089 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 22:50:21.357435 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.357039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55592)
0809 22:50:21.357205 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.357306 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 22:50:21.402285 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 31826
I20260809 22:50:21.418004 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.417380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55600)
0809 22:50:21.417615 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.417753 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 22:50:21.419865 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.419296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55610)
0809 22:50:21.419537 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.419668 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 22:50:21.432912 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 32032
I20260809 22:50:21.435889 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.433824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47888 (local address 127.23.131.67:44437)
0809 22:50:21.434043 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:21.434048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:21.434069 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:50:21.434132 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:21.434135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:21.434219 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:21.434311 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:21.435309 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:21.435314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:21.435317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:21.435337 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:21.435375 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:21.435389 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:21.435527 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:21.435596 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 22:50:21.435648 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 22:50:21.436589 32233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:21.500711 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.500176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55620)
0809 22:50:21.500455 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.500558 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 22:50:21.501999 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:21.501528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:46417 (local address 127.0.0.1:55634)
0809 22:50:21.501784 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:21.501857 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:46417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 22:50:21.527079 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 32032
I20260809 22:50:21.553264 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 31466
I20260809 22:50:21.554488 31556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:21.666427 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 31466
2026-08-09T22:50:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2829 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 22:50:21.727362 24077 mini_oidc.cc:152] Starting JWKS server
I20260809 22:50:21.730223 24077 webserver.cc:460] Webserver started at https://127.0.0.1:39805/ using document root <none> and password file <none>
I20260809 22:50:21.730597 24077 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 22:50:21.731451 24077 webserver.cc:460] Webserver started at http://127.0.0.1:46431/ using document root <none> and password file <none>
2026-08-09T22:50:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:21Z Disabled control of system clock
I20260809 22:50:21.773397 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:42893
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:42033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:42893
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39805/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/testchainca.cert with env {}
W20260809 22:50:22.134876 32338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:22.135280 32338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:22.135476 32338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:22.143731 32338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:22.143903 32338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:22.143999 32338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:22.144134 32338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:22.144230 32338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 22:50:22.144338 32338 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 22:50:22.144438 32338 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39805/jwks.json
I20260809 22:50:22.155373 32338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:42893
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:42893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39805/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:22.156744 32338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:22.158084 32338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:22.170550 32345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:22.170522 32348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:22.170504 32346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:22.171864 32338 server_base.cc:1034] running on GCE node
I20260809 22:50:22.172726 32338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:22.174260 32338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:22.175498 32338 hybrid_clock.cc:648] HybridClock initialized: now 1786315822175432 us; error 61 us; skew 500 ppm
I20260809 22:50:22.175865 32338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:22.181416 32338 webserver.cc:460] Webserver started at http://127.23.131.126:34299/ using document root <none> and password file <none>
I20260809 22:50:22.182225 32338 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:22.182371 32338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:22.182695 32338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:22.185863 32338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "7ae2385a804649c39f06942aac08d53c"
format_stamp: "Formatted at 2026-08-09 22:50:22 on dist-test-slave-92m1"
server_key: "d754188b1585c9a0089c3b851d25d48d"
server_key_iv: "32714655291a9273bf49f169ae34ce9e"
server_key_version: "encryptionkey@0"
I20260809 22:50:22.186717 32338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "7ae2385a804649c39f06942aac08d53c"
format_stamp: "Formatted at 2026-08-09 22:50:22 on dist-test-slave-92m1"
server_key: "d754188b1585c9a0089c3b851d25d48d"
server_key_iv: "32714655291a9273bf49f169ae34ce9e"
server_key_version: "encryptionkey@0"
I20260809 22:50:22.194497 32338 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 22:50:22.198046 32360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:22.199587 32338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:22.199791 32338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "7ae2385a804649c39f06942aac08d53c"
format_stamp: "Formatted at 2026-08-09 22:50:22 on dist-test-slave-92m1"
server_key: "d754188b1585c9a0089c3b851d25d48d"
server_key_iv: "32714655291a9273bf49f169ae34ce9e"
server_key_version: "encryptionkey@0"
I20260809 22:50:22.200031 32338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:22.223001 32338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:22.223902 32338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:22.224247 32338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:22.243940 32338 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:42893
I20260809 22:50:22.243959 32444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:42893 every 8 connection(s)
I20260809 22:50:22.245405 32338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:22.249251 32446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:22.249877 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 32338
I20260809 22:50:22.250119 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:22.250968 24077 external_mini_cluster.cc:1428] Setting key fd7e32a13fafe38a22b611af370ffea7
I20260809 22:50:22.262283 32446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c: Bootstrap starting.
I20260809 22:50:22.265558 32452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:22.253067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42486 (local address 127.23.131.126:42893)
0809 22:50:22.254093 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:22.254104 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:22.254146 (+ 42us) server_negotiation.cc:407] Connection header received
0809 22:50:22.256193 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:22.256215 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:22.256697 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:22.257101 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:22.257664 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:22.258943 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:22.260441 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:22.261106 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:22.261310 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:22.262616 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:22.262627 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:22.262645 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:22.263382 (+ 737us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:22.263492 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:22.263520 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:22.263650 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:22.263878 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 22:50:22.264272 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":363,"threads_started":1}
I20260809 22:50:22.266561 32446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:22.267735 32446 log.cc:824] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:22.269521 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:50:22.271090 32446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c: No bootstrap required, opened a new log
I20260809 22:50:22.278661 32446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ae2385a804649c39f06942aac08d53c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42893 } }
I20260809 22:50:22.279019 32446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:22.279142 32446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae2385a804649c39f06942aac08d53c, State: Initialized, Role: FOLLOWER
I20260809 22:50:22.279860 32446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ae2385a804649c39f06942aac08d53c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42893 } }
I20260809 22:50:22.280109 32446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:22.280268 32446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:22.280453 32446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:22.282670 32446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ae2385a804649c39f06942aac08d53c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42893 } }
I20260809 22:50:22.283246 32446 leader_election.cc:302] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ae2385a804649c39f06942aac08d53c; no voters:
I20260809 22:50:22.283885 32446 leader_election.cc:288] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:22.284127 32455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:22.285480 32455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [term 1 LEADER]: Becoming Leader. State: Replica: 7ae2385a804649c39f06942aac08d53c, State: Running, Role: LEADER
I20260809 22:50:22.286100 32455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ae2385a804649c39f06942aac08d53c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42893 } }
I20260809 22:50:22.286686 32446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:22.289283 32460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ae2385a804649c39f06942aac08d53c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ae2385a804649c39f06942aac08d53c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42893 } } }
I20260809 22:50:22.289904 32460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:22.290953 32470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:22.289431 32461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ae2385a804649c39f06942aac08d53c. Latest consensus state: current_term: 1 leader_uuid: "7ae2385a804649c39f06942aac08d53c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ae2385a804649c39f06942aac08d53c" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42893 } } }
I20260809 22:50:22.292569 32461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:22.297008 32470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:22.307341 32470 catalog_manager.cc:1347] Generated new cluster ID: 1bfff0e6945e4ae48ea843df6850b577
I20260809 22:50:22.307482 32470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:22.324868 32470 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:22.326404 32470 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:22.339015 32470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ae2385a804649c39f06942aac08d53c: Generated new TSK 0
I20260809 22:50:22.340152 32470 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 22:50:22.385226 32498 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 22:50:22.385488 32498 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 22:50:22.386772 32452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:22.364881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.23.131.126:42893)
0809 22:50:22.365073 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:22.365078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:22.365662 (+ 584us) server_negotiation.cc:407] Connection header received
0809 22:50:22.366081 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:22.366086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:22.366161 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:22.366324 (+ 163us) server_negotiation.cc:226] Negotiated authn=JWT
0809 22:50:22.366941 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:22.367782 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:22.369344 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:22.369778 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:22.369947 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:22.370543 (+ 596us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 22:50:22.386044 (+ 15501us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39805/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 22:50:22.386452 (+ 408us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39805/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 22:50:22.386931 32452 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39805/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 22:50:22.389035 32494 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:22.364882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:42893 (local address 127.0.0.1:42488)
0809 22:50:22.365534 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:22.365556 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:22.365773 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:22.366357 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:22.366364 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:22.366390 (+ 26us) client_negotiation.cc:189] Negotiated authn=JWT
0809 22:50:22.366766 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:22.366776 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:22.367988 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:22.367994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:22.369191 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:22.369203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:22.369982 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:22.369990 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:22.370140 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:22.370209 (+ 69us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 22:50:22.386420 (+ 16211us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39805/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 22:50:22.386803 (+ 383us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.131.126:42893: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39805/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":322,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.23.131.126:42893: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39805/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 22:50:22.390947 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 32338
I20260809 22:50:22.392427 32437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:22.492803 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 32338
2026-08-09T22:50:22Z chronyd exiting
I20260809 22:50:22.554406 24077 test_util.cc:175] -----------------------------------------------
I20260809 22:50:22.554611 24077 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786315774646092-24077-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (832 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 22:50:22.560376 24077 mini_oidc.cc:152] Starting JWKS server
I20260809 22:50:22.563719 24077 webserver.cc:460] Webserver started at https://127.0.0.1:35235/ using document root <none> and password file <none>
I20260809 22:50:22.564002 24077 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 22:50:22.564894 24077 webserver.cc:460] Webserver started at http://127.0.0.1:37399/ using document root <none> and password file <none>
2026-08-09T22:50:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:22Z Disabled control of system clock
I20260809 22:50:22.608903 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:42187
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:44057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:42187
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35235/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/testchainca.cert with env {}
W20260809 22:50:22.970546 32507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:22.970888 32507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:22.971004 32507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:22.978765 32507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:22.978921 32507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:22.978969 32507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:22.979023 32507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:22.979071 32507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 22:50:22.979147 32507 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 22:50:22.979192 32507 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35235/jwks.json
I20260809 22:50:22.990056 32507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:44057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:42187
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:42187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35235/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:22.991466 32507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:22.992820 32507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:23.005714 32520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:23.005684 32523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:23.005684 32521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:23.006330 32507 server_base.cc:1034] running on GCE node
I20260809 22:50:23.007304 32507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:23.008852 32507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:23.010113 32507 hybrid_clock.cc:648] HybridClock initialized: now 1786315823010078 us; error 61 us; skew 500 ppm
I20260809 22:50:23.010495 32507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:23.012892 32507 webserver.cc:460] Webserver started at http://127.23.131.126:36111/ using document root <none> and password file <none>
I20260809 22:50:23.013618 32507 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:23.013761 32507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:23.014113 32507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:23.017233 32507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "8c7d799b3f334a8ba1f39d964295442d"
format_stamp: "Formatted at 2026-08-09 22:50:23 on dist-test-slave-92m1"
server_key: "d70e4b1cc9ec69c2ad84ce26bb46bc1a"
server_key_iv: "e00f1fc1b8de80a72982cce71432c322"
server_key_version: "encryptionkey@0"
I20260809 22:50:23.018160 32507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "8c7d799b3f334a8ba1f39d964295442d"
format_stamp: "Formatted at 2026-08-09 22:50:23 on dist-test-slave-92m1"
server_key: "d70e4b1cc9ec69c2ad84ce26bb46bc1a"
server_key_iv: "e00f1fc1b8de80a72982cce71432c322"
server_key_version: "encryptionkey@0"
I20260809 22:50:23.023849 32507 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 22:50:23.027757 32538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:23.029335 32507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:50:23.029543 32507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "8c7d799b3f334a8ba1f39d964295442d"
format_stamp: "Formatted at 2026-08-09 22:50:23 on dist-test-slave-92m1"
server_key: "d70e4b1cc9ec69c2ad84ce26bb46bc1a"
server_key_iv: "e00f1fc1b8de80a72982cce71432c322"
server_key_version: "encryptionkey@0"
I20260809 22:50:23.029798 32507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:23.045572 32507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:23.046502 32507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:23.046847 32507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:23.066727 32507 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:42187
I20260809 22:50:23.066747 32635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:42187 every 8 connection(s)
I20260809 22:50:23.068255 32507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:23.072146 32636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:23.075013 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 32507
I20260809 22:50:23.075271 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:23.075971 24077 external_mini_cluster.cc:1428] Setting key fd246136e3c643e887aee40c916c9630
I20260809 22:50:23.085067 32636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d: Bootstrap starting.
I20260809 22:50:23.089012 32636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:23.090181 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:23.077999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43370 (local address 127.23.131.126:42187)
0809 22:50:23.079082 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:23.079093 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:23.079134 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:50:23.080864 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:23.080887 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:23.081371 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:23.081716 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:23.082362 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.083796 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.085644 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.086304 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.086461 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:23.087830 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:23.087837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:23.087850 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:23.088378 (+ 528us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:23.088467 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:23.088487 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:23.088579 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:23.088814 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 22:50:23.089176 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":410,"threads_started":1}
I20260809 22:50:23.090271 32636 log.cc:824] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:23.094077 32636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d: No bootstrap required, opened a new log
I20260809 22:50:23.095954 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:50:23.105520 32636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c7d799b3f334a8ba1f39d964295442d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42187 } }
I20260809 22:50:23.105923 32636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:23.106009 32636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c7d799b3f334a8ba1f39d964295442d, State: Initialized, Role: FOLLOWER
I20260809 22:50:23.106544 32636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c7d799b3f334a8ba1f39d964295442d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42187 } }
I20260809 22:50:23.106763 32636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:23.106925 32636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:23.107138 32636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:23.109539 32636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c7d799b3f334a8ba1f39d964295442d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42187 } }
I20260809 22:50:23.110070 32636 leader_election.cc:302] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c7d799b3f334a8ba1f39d964295442d; no voters:
I20260809 22:50:23.110710 32636 leader_election.cc:288] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:23.110893 32649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:23.111771 32649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [term 1 LEADER]: Becoming Leader. State: Replica: 8c7d799b3f334a8ba1f39d964295442d, State: Running, Role: LEADER
I20260809 22:50:23.112349 32649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c7d799b3f334a8ba1f39d964295442d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42187 } }
I20260809 22:50:23.112967 32636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:23.115296 32650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c7d799b3f334a8ba1f39d964295442d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c7d799b3f334a8ba1f39d964295442d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42187 } } }
I20260809 22:50:23.115787 32650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:23.115593 32652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c7d799b3f334a8ba1f39d964295442d. Latest consensus state: current_term: 1 leader_uuid: "8c7d799b3f334a8ba1f39d964295442d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c7d799b3f334a8ba1f39d964295442d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42187 } } }
I20260809 22:50:23.116448 32652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:23.118323 32655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:23.123715 32655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:23.134251 32655 catalog_manager.cc:1347] Generated new cluster ID: 8d469a6839324234a51290c89434ed24
I20260809 22:50:23.134403 32655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:23.158418 32655 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:23.159893 32655 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:23.175765 32655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c7d799b3f334a8ba1f39d964295442d: Generated new TSK 0
I20260809 22:50:23.176645 32655 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 22:50:23.220045 32690 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 22:50:23.220191 32690 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 22:50:23.221385 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:23.191821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43380 (local address 127.23.131.126:42187)
0809 22:50:23.192026 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:23.192033 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:23.192503 (+ 470us) server_negotiation.cc:407] Connection header received
0809 22:50:23.192766 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:23.192772 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:23.192876 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:23.193046 (+ 170us) server_negotiation.cc:226] Negotiated authn=JWT
0809 22:50:23.193519 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.194708 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.196250 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.196958 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.197083 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:23.197667 (+ 584us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 22:50:23.220620 (+ 22953us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 22:50:23.221053 (+ 433us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43380: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 22:50:23.221547 32646 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43380: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 22:50:23.221728 32688 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:23.191648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:42187 (local address 127.0.0.1:43380)
0809 22:50:23.192401 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:23.192418 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:23.192550 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:23.193062 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:23.193066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:23.193077 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0809 22:50:23.193345 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:23.193353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.194883 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.194887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:23.196108 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:23.196120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.197130 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.197136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:23.197309 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:23.197343 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 22:50:23.220910 (+ 23567us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 22:50:23.221202 (+ 292us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.131.126:42187: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":460,"threads_started":1}
I20260809 22:50:23.223151 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 32507
I20260809 22:50:23.224498 32630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:23.324414 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 32507
2026-08-09T22:50:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (833 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 22:50:23.391927 24077 mini_oidc.cc:152] Starting JWKS server
I20260809 22:50:23.393867 24077 webserver.cc:460] Webserver started at https://127.0.0.1:41323/ using document root <none> and password file <none>
I20260809 22:50:23.394093 24077 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 22:50:23.394701 24077 webserver.cc:460] Webserver started at http://127.0.0.1:40329/ using document root <none> and password file <none>
2026-08-09T22:50:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:23Z Disabled control of system clock
I20260809 22:50:23.437839 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:38917
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:45841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:38917
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41323/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 22:50:23.800163 32704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:23.800544 32704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:23.800719 32704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:23.808408 32704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:23.808568 32704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:23.808660 32704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:23.808782 32704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:23.808863 32704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 22:50:23.808959 32704 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 22:50:23.809039 32704 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41323/jwks.json
I20260809 22:50:23.818733 32704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:45841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:38917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:38917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41323/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:23.820498 32704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:23.822517 32704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:23.835045 32713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:23.835129 32716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:23.835129 32710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:23.836045 32704 server_base.cc:1034] running on GCE node
I20260809 22:50:23.836928 32704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:23.838378 32704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:23.839613 32704 hybrid_clock.cc:648] HybridClock initialized: now 1786315823839550 us; error 32 us; skew 500 ppm
I20260809 22:50:23.839941 32704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:23.842334 32704 webserver.cc:460] Webserver started at http://127.23.131.126:43653/ using document root <none> and password file <none>
I20260809 22:50:23.842983 32704 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:23.843091 32704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:23.843466 32704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:23.846418 32704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "b2f6aee8055a448cabf447f40919a397"
format_stamp: "Formatted at 2026-08-09 22:50:23 on dist-test-slave-92m1"
server_key: "5dcfa1990115e44249cc56db50c8c283"
server_key_iv: "5dddc7ee28fcbe3c460b916c5b924508"
server_key_version: "encryptionkey@0"
I20260809 22:50:23.847347 32704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "b2f6aee8055a448cabf447f40919a397"
format_stamp: "Formatted at 2026-08-09 22:50:23 on dist-test-slave-92m1"
server_key: "5dcfa1990115e44249cc56db50c8c283"
server_key_iv: "5dddc7ee28fcbe3c460b916c5b924508"
server_key_version: "encryptionkey@0"
I20260809 22:50:23.852492 32704 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260809 22:50:23.856068 32728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:23.857503 32704 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:23.857661 32704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "b2f6aee8055a448cabf447f40919a397"
format_stamp: "Formatted at 2026-08-09 22:50:23 on dist-test-slave-92m1"
server_key: "5dcfa1990115e44249cc56db50c8c283"
server_key_iv: "5dddc7ee28fcbe3c460b916c5b924508"
server_key_version: "encryptionkey@0"
I20260809 22:50:23.857856 32704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:23.882102 32704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:23.882961 32704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:23.883338 32704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:23.903829 32704 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:38917
I20260809 22:50:23.903851 342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:38917 every 8 connection(s)
I20260809 22:50:23.905267 32704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:23.908447 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 32704
I20260809 22:50:23.908682 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:23.909562 24077 external_mini_cluster.cc:1428] Setting key 77e58bb32b3fce6863e67cf17ae2e8a9
I20260809 22:50:23.909690 344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:23.923841 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:23.911573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41846 (local address 127.23.131.126:38917)
0809 22:50:23.912648 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:23.912658 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:23.912706 (+ 48us) server_negotiation.cc:407] Connection header received
0809 22:50:23.914511 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:23.914532 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:23.914989 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:23.915404 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:23.915990 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.917346 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.919289 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:23.919969 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:23.920128 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:23.921389 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:23.921395 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:23.921410 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:23.922003 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:23.922097 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:23.922118 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:23.922210 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:23.922454 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 22:50:23.922801 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":431,"threads_started":1}
I20260809 22:50:23.924278 344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397: Bootstrap starting.
I20260809 22:50:23.927681 344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:23.927901 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:50:23.928753 344 log.cc:824] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:23.931970 344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397: No bootstrap required, opened a new log
I20260809 22:50:23.939626 344 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2f6aee8055a448cabf447f40919a397" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38917 } }
I20260809 22:50:23.940042 344 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:23.940164 344 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2f6aee8055a448cabf447f40919a397, State: Initialized, Role: FOLLOWER
I20260809 22:50:23.940812 344 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2f6aee8055a448cabf447f40919a397" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38917 } }
I20260809 22:50:23.941064 344 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:23.941226 344 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:23.941390 344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:23.943694 344 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2f6aee8055a448cabf447f40919a397" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38917 } }
I20260809 22:50:23.944218 344 leader_election.cc:302] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2f6aee8055a448cabf447f40919a397; no voters:
I20260809 22:50:23.944931 344 leader_election.cc:288] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:23.945161 353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:23.946981 353 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [term 1 LEADER]: Becoming Leader. State: Replica: b2f6aee8055a448cabf447f40919a397, State: Running, Role: LEADER
I20260809 22:50:23.947388 344 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:23.947645 353 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2f6aee8055a448cabf447f40919a397" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38917 } }
I20260809 22:50:23.951102 354 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2f6aee8055a448cabf447f40919a397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2f6aee8055a448cabf447f40919a397" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38917 } } }
I20260809 22:50:23.951095 355 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2f6aee8055a448cabf447f40919a397. Latest consensus state: current_term: 1 leader_uuid: "b2f6aee8055a448cabf447f40919a397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2f6aee8055a448cabf447f40919a397" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38917 } } }
I20260809 22:50:23.951700 355 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:23.951563 354 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:23.956571 363 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:23.961128 363 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:23.970077 363 catalog_manager.cc:1347] Generated new cluster ID: 4c490e2894314c539368e233b1d06c5b
I20260809 22:50:23.970222 363 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:23.994428 363 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:23.995910 363 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:24.001657 363 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2f6aee8055a448cabf447f40919a397: Generated new TSK 0
I20260809 22:50:24.002533 363 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:50:24.034303 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:24.025362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41854 (local address 127.23.131.126:38917)
0809 22:50:24.025628 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:24.025634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:24.026015 (+ 381us) server_negotiation.cc:407] Connection header received
0809 22:50:24.026243 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:24.026247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:24.026320 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:24.026443 (+ 123us) server_negotiation.cc:226] Negotiated authn=JWT
0809 22:50:24.026983 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.027783 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.029890 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.030400 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.030527 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:24.031192 (+ 665us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 22:50:24.033644 (+ 2452us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 22:50:24.033993 (+ 349us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41854: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 22:50:24.034454 350 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41854: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 22:50:24.036473 384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:24.025257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38917 (local address 127.0.0.1:41854)
0809 22:50:24.025903 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:24.025924 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:24.026087 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:24.026494 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:24.026500 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:24.026515 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0809 22:50:24.026830 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:24.026843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.027931 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.027938 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:24.029678 (+ 1740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:24.029694 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.030630 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.030638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:24.030840 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:24.030897 (+ 57us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 22:50:24.033889 (+ 2992us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 22:50:24.036005 (+ 2116us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.131.126:38917: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":1805,"thread_start_us":335,"threads_started":1}
I20260809 22:50:24.037580 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 32704
I20260809 22:50:24.038770 338 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 22:50:24.046072 385 webserver.cc:533] Webserver: sslize failed:
E20260809 22:50:24.046173 385 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 22:50:24.133311 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 32704
2026-08-09T22:50:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (808 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T22:50:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:24Z Disabled control of system clock
I20260809 22:50:24.244629 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40383
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:42257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:40383
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/testchainca.cert with env {}
W20260809 22:50:24.601034 391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:24.601387 391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:24.601553 391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:24.609211 391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:24.609359 391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:24.609400 391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:24.609459 391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:24.609505 391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 22:50:24.609563 391 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 22:50:24.609604 391 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 22:50:24.620270 391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:40383
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:24.621631 391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:24.623055 391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:24.635648 396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:24.635671 400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:24.635598 398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:24.636494 391 server_base.cc:1034] running on GCE node
I20260809 22:50:24.637327 391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:24.638708 391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:24.639931 391 hybrid_clock.cc:648] HybridClock initialized: now 1786315824639847 us; error 63 us; skew 500 ppm
I20260809 22:50:24.640306 391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:24.642736 391 webserver.cc:460] Webserver started at http://127.23.131.126:45407/ using document root <none> and password file <none>
I20260809 22:50:24.643543 391 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:24.643668 391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:24.644011 391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:24.646932 391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "5cb1938be224407d99531abbc3d3b0a4"
format_stamp: "Formatted at 2026-08-09 22:50:24 on dist-test-slave-92m1"
server_key: "c59610de0833cd8e0bfda671fbe034ca"
server_key_iv: "7720c03e6a7a1046735cbb3506815bf5"
server_key_version: "encryptionkey@0"
I20260809 22:50:24.647821 391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "5cb1938be224407d99531abbc3d3b0a4"
format_stamp: "Formatted at 2026-08-09 22:50:24 on dist-test-slave-92m1"
server_key: "c59610de0833cd8e0bfda671fbe034ca"
server_key_iv: "7720c03e6a7a1046735cbb3506815bf5"
server_key_version: "encryptionkey@0"
I20260809 22:50:24.652944 391 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:50:24.656395 409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:24.657707 391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:24.657898 391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "5cb1938be224407d99531abbc3d3b0a4"
format_stamp: "Formatted at 2026-08-09 22:50:24 on dist-test-slave-92m1"
server_key: "c59610de0833cd8e0bfda671fbe034ca"
server_key_iv: "7720c03e6a7a1046735cbb3506815bf5"
server_key_version: "encryptionkey@0"
I20260809 22:50:24.658149 391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:24.681422 391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:24.682404 391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:24.682715 391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:24.702924 391 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:40383
I20260809 22:50:24.702932 493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:40383 every 8 connection(s)
I20260809 22:50:24.704423 391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:24.708225 494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:24.714012 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 391
I20260809 22:50:24.714212 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:24.714910 24077 external_mini_cluster.cc:1428] Setting key efbc3af42219e7a421d78c5bd1ca1ee0
I20260809 22:50:24.719447 494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4: Bootstrap starting.
I20260809 22:50:24.722937 494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:24.724285 494 log.cc:824] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:24.727840 494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4: No bootstrap required, opened a new log
I20260809 22:50:24.729687 500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:24.717090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35332 (local address 127.23.131.126:40383)
0809 22:50:24.718170 (+ 1080us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:24.718181 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:24.718224 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:50:24.720086 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:24.720109 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:24.720542 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:24.720853 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:24.721560 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.722847 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.724819 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.725989 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.726121 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:24.727403 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:24.727411 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:24.727425 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:50:24.727996 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:24.728077 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:50:24.728099 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:24.728186 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:24.728429 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 22:50:24.728756 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":427,"threads_started":1}
I20260809 22:50:24.733608 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:50:24.736373 494 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb1938be224407d99531abbc3d3b0a4" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40383 } }
I20260809 22:50:24.736752 494 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:24.736886 494 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cb1938be224407d99531abbc3d3b0a4, State: Initialized, Role: FOLLOWER
I20260809 22:50:24.737424 494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb1938be224407d99531abbc3d3b0a4" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40383 } }
I20260809 22:50:24.737664 494 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:24.737814 494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:24.738013 494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:24.740492 494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb1938be224407d99531abbc3d3b0a4" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40383 } }
I20260809 22:50:24.741019 494 leader_election.cc:302] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cb1938be224407d99531abbc3d3b0a4; no voters:
I20260809 22:50:24.741724 494 leader_election.cc:288] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:24.742009 505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:24.743191 505 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [term 1 LEADER]: Becoming Leader. State: Replica: 5cb1938be224407d99531abbc3d3b0a4, State: Running, Role: LEADER
I20260809 22:50:24.743819 505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb1938be224407d99531abbc3d3b0a4" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40383 } }
I20260809 22:50:24.744150 494 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:24.746475 508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cb1938be224407d99531abbc3d3b0a4. Latest consensus state: current_term: 1 leader_uuid: "5cb1938be224407d99531abbc3d3b0a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb1938be224407d99531abbc3d3b0a4" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40383 } } }
I20260809 22:50:24.746774 508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:24.747319 507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cb1938be224407d99531abbc3d3b0a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb1938be224407d99531abbc3d3b0a4" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40383 } } }
I20260809 22:50:24.747673 507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:24.747819 512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:24.753269 512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:24.762818 512 catalog_manager.cc:1347] Generated new cluster ID: 43ab02eb77c548edb76540f9b547531e
I20260809 22:50:24.762981 512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:24.779685 512 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:24.780963 512 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:24.788839 512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cb1938be224407d99531abbc3d3b0a4: Generated new TSK 0
I20260809 22:50:24.789651 512 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:50:25.236383 500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:24.804343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35344 (local address 127.23.131.126:40383)
0809 22:50:24.804629 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:24.804637 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:24.805000 (+ 363us) server_negotiation.cc:407] Connection header received
0809 22:50:24.805261 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:24.805265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:24.805339 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:24.805523 (+ 184us) server_negotiation.cc:226] Negotiated authn=JWT
0809 22:50:24.806010 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.806749 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.808247 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.808716 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.808879 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:24.809381 (+ 502us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 22:50:25.235595 (+426214us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 22:50:25.236060 (+ 465us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35344: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 22:50:25.236546 500 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35344: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 22:50:25.236649 545 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:24.804253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40383 (local address 127.0.0.1:35344)
0809 22:50:24.804891 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:24.804908 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:24.805078 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:24.805537 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:24.805543 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:24.805556 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0809 22:50:24.805851 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:24.805861 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.806908 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.806913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:24.808095 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:24.808107 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:24.808906 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:24.808913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:24.809078 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:24.809113 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 22:50:25.235919 (+426806us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 22:50:25.236226 (+ 307us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.131.126:40383: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":330,"threads_started":1}
I20260809 22:50:25.237843 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 391
I20260809 22:50:25.239041 488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:25.347705 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 391
2026-08-09T22:50:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1196 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (454 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (454 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:26 dist-test-slave-92m1 krb5kdc[568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:26 dist-test-slave-92m1 krb5kdc[568](info): set up 2 sockets
Aug 09 22:50:26 dist-test-slave-92m1 krb5kdc[568](info): commencing operation
krb5kdc: starting...
W20260809 22:50:27.605996 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.005s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:27 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:27.907421 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:42883
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:42883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:28.266191 595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:28.266498 595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:28.266675 595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:28.274242 595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:28.274369 595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:28.274474 595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:28.274580 595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:28.274667 595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:28.285225 595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:42883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:42883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:28.286700 595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:28.288069 595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:28.300978 603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:28.300895 604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:28.301008 607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:28.302035 595 server_base.cc:1034] running on GCE node
I20260809 22:50:28.302845 595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:28.304468 595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:28.305725 595 hybrid_clock.cc:648] HybridClock initialized: now 1786315828305670 us; error 26 us; skew 500 ppm
I20260809 22:50:28.306118 595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:28 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315828, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:28.312249 595 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:28.314128 595 webserver.cc:460] Webserver started at http://127.23.131.126:44907/ using document root <none> and password file <none>
I20260809 22:50:28.314888 595 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:28.315062 595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:28.315476 595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:28.318707 595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "5b91a1a8454e4454b42106e78d63558f"
format_stamp: "Formatted at 2026-08-09 22:50:28 on dist-test-slave-92m1"
server_key: "e22a9225d2e32999477972577bf17c5b"
server_key_iv: "9581bcb8d60715ea9b708f2b3f87cff1"
server_key_version: "encryptionkey@0"
I20260809 22:50:28.319651 595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "5b91a1a8454e4454b42106e78d63558f"
format_stamp: "Formatted at 2026-08-09 22:50:28 on dist-test-slave-92m1"
server_key: "e22a9225d2e32999477972577bf17c5b"
server_key_iv: "9581bcb8d60715ea9b708f2b3f87cff1"
server_key_version: "encryptionkey@0"
I20260809 22:50:28.325345 595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:50:28.329241 617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:28.330708 595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:50:28.330916 595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "5b91a1a8454e4454b42106e78d63558f"
format_stamp: "Formatted at 2026-08-09 22:50:28 on dist-test-slave-92m1"
server_key: "e22a9225d2e32999477972577bf17c5b"
server_key_iv: "9581bcb8d60715ea9b708f2b3f87cff1"
server_key_version: "encryptionkey@0"
I20260809 22:50:28.331151 595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:28.360108 595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:28.364506 595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:28.364822 595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:28.385054 595 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:42883
I20260809 22:50:28.385113 707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:42883 every 8 connection(s)
I20260809 22:50:28.386528 595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:28.388657 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 595
I20260809 22:50:28.388904 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:28.389760 24077 external_mini_cluster.cc:1428] Setting key c800b80ff8c903b36d53587d51db5671
I20260809 22:50:28.391331 708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:50:28 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:28.403703 708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f: Bootstrap starting.
I20260809 22:50:28.407624 708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:28.408768 708 log.cc:824] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:28.412362 708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f: No bootstrap required, opened a new log
I20260809 22:50:28.413007 714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:28.392002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48810 (local address 127.23.131.126:42883)
0809 22:50:28.392813 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:28.392825 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:28.392865 (+ 40us) server_negotiation.cc:407] Connection header received
0809 22:50:28.394508 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:28.394529 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:28.394898 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:28.395321 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:28.396786 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:28.398186 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:28.399534 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:28.400219 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:28.400454 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:28.404750 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:28.404758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:28.404772 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:28.404809 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:28.408339 (+ 3530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:28.409147 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:28.409154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:28.409160 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:28.409521 (+ 361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:28.410003 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:28.410012 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:28.410016 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:28.410676 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:28.410906 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:28.411470 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 22:50:28.411860 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":354,"threads_started":1}
I20260809 22:50:28.420428 708 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b91a1a8454e4454b42106e78d63558f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42883 } }
I20260809 22:50:28.420866 708 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:28.420986 708 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b91a1a8454e4454b42106e78d63558f, State: Initialized, Role: FOLLOWER
I20260809 22:50:28.421566 708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b91a1a8454e4454b42106e78d63558f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42883 } }
I20260809 22:50:28.421821 708 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:28.422026 708 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:28.422281 708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:28.424958 708 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b91a1a8454e4454b42106e78d63558f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42883 } }
I20260809 22:50:28.425447 708 leader_election.cc:302] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b91a1a8454e4454b42106e78d63558f; no voters:
I20260809 22:50:28.426100 708 leader_election.cc:288] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:28.426283 718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:28.427134 718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [term 1 LEADER]: Becoming Leader. State: Replica: 5b91a1a8454e4454b42106e78d63558f, State: Running, Role: LEADER
I20260809 22:50:28.427688 718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b91a1a8454e4454b42106e78d63558f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42883 } }
I20260809 22:50:28.428427 708 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:28.430895 720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b91a1a8454e4454b42106e78d63558f. Latest consensus state: current_term: 1 leader_uuid: "5b91a1a8454e4454b42106e78d63558f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b91a1a8454e4454b42106e78d63558f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42883 } } }
I20260809 22:50:28.431186 719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b91a1a8454e4454b42106e78d63558f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b91a1a8454e4454b42106e78d63558f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 42883 } } }
I20260809 22:50:28.431767 720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:28.431803 719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:28.438400 726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:28.444926 726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:28.452097 739 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 22:50:28.457265 726 catalog_manager.cc:1347] Generated new cluster ID: 95f3c7c3f75743edb32d05118dd073a9
I20260809 22:50:28.457391 726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:28.471649 726 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:28.473644 726 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:28.487928 726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b91a1a8454e4454b42106e78d63558f: Generated new TSK 0
I20260809 22:50:28.489121 726 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:50:28.553333 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:42883
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:28.923079 746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:28.923553 746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:28.923750 746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:28.931589 746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:28.931743 746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:28.931957 746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:28.942915 746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:42883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:28.944443 746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:28.945940 746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:28.961444 758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:28.961445 757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:28.962066 762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:28.962463 746 server_base.cc:1034] running on GCE node
I20260809 22:50:28.963147 746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:28.964248 746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:28.965502 746 hybrid_clock.cc:648] HybridClock initialized: now 1786315828965444 us; error 53 us; skew 500 ppm
I20260809 22:50:28.965845 746 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:28 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315828, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:28.969461 746 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:50:28.970988 746 webserver.cc:460] Webserver started at http://127.23.131.65:34295/ using document root <none> and password file <none>
I20260809 22:50:28.971807 746 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:28.971992 746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:28.972340 746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:28.975720 746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "17d7d1ce2bb84cf0ac9c2ce493be834d"
format_stamp: "Formatted at 2026-08-09 22:50:28 on dist-test-slave-92m1"
server_key: "bb3089cdf64bddafda3a8e491c41ed32"
server_key_iv: "e47326e0ca245f7ee14a7b9278c09bbc"
server_key_version: "encryptionkey@0"
I20260809 22:50:28.976640 746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "17d7d1ce2bb84cf0ac9c2ce493be834d"
format_stamp: "Formatted at 2026-08-09 22:50:28 on dist-test-slave-92m1"
server_key: "bb3089cdf64bddafda3a8e491c41ed32"
server_key_iv: "e47326e0ca245f7ee14a7b9278c09bbc"
server_key_version: "encryptionkey@0"
I20260809 22:50:28.982563 746 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:28.986543 775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:28.988163 746 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:28.988374 746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "17d7d1ce2bb84cf0ac9c2ce493be834d"
format_stamp: "Formatted at 2026-08-09 22:50:28 on dist-test-slave-92m1"
server_key: "bb3089cdf64bddafda3a8e491c41ed32"
server_key_iv: "e47326e0ca245f7ee14a7b9278c09bbc"
server_key_version: "encryptionkey@0"
I20260809 22:50:28.988622 746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:29.009636 746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:29.014310 746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:29.014657 746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:29.015771 746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:29.017347 746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:29.017464 746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:29.017634 746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:29.017712 746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:29.055122 746 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:42699
I20260809 22:50:29.055235 961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:42699 every 8 connection(s)
I20260809 22:50:29.056609 746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:29.065199 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 746
I20260809 22:50:29.065474 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:29.066250 24077 external_mini_cluster.cc:1428] Setting key 911aa3e7dc61f785f010a463366bc718
Aug 09 22:50:29 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315828, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:29.078933 964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:29.059428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:42701 (local address 127.23.131.126:42883)
0809 22:50:29.059950 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:29.059955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:29.060865 (+ 910us) server_negotiation.cc:407] Connection header received
0809 22:50:29.062798 (+ 1933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:29.062804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:29.062918 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:29.063046 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:29.064723 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.065543 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.067420 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.068031 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.068181 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:29.072800 (+ 4619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:29.072806 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:29.072809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:29.072844 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:29.075656 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:29.076472 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:29.076484 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:29.076488 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:29.076611 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:29.077079 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:29.077088 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:29.077090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:29.077365 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:29.077540 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:29.078283 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 22:50:29.078522 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":276,"threads_started":1}
I20260809 22:50:29.079988 966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:29.059908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:42883 (local address 127.23.131.65:42701)
0809 22:50:29.060690 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:29.060728 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:29.062498 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:29.063352 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:29.063361 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:29.063920 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:29.064524 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:29.064542 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.065746 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.065750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:29.067277 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:29.067291 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.068378 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.068386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:29.068686 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:29.069482 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:29.069527 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:29.072497 (+ 2970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:29.075821 (+ 3324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:29.075831 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:29.075852 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:29.076321 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:29.076734 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:29.076739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:29.076742 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:29.076952 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:29.077504 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:29.077514 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:29.077892 (+ 378us) client_negotiation.cc:769] Sending connection context
0809 22:50:29.078186 (+ 294us) client_negotiation.cc:240] Negotiation successful
0809 22:50:29.078776 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":340,"threads_started":1}
I20260809 22:50:29.081713 962 heartbeater.cc:347] Connected to a master server at 127.23.131.126:42883
I20260809 22:50:29.082039 962 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:29.082821 962 heartbeater.cc:511] Master 127.23.131.126:42883 requested a full tablet report, sending...
I20260809 22:50:29.085071 638 ts_manager.cc:194] Registered new tserver with Master: 17d7d1ce2bb84cf0ac9c2ce493be834d (127.23.131.65:42699)
I20260809 22:50:29.086557 638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:42701
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:50:29.134264 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:42883
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:29.488893 969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:29.489199 969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:29.489355 969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:29.497037 969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:29.497167 969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:29.497355 969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:29.507714 969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:42883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:29.509176 969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:29.510578 969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:29.525079 978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:29.525035 975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:29.525127 974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:29.525488 969 server_base.cc:1034] running on GCE node
I20260809 22:50:29.526414 969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:29.527519 969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:29.528766 969 hybrid_clock.cc:648] HybridClock initialized: now 1786315829528705 us; error 50 us; skew 500 ppm
I20260809 22:50:29.529165 969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:29 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315829, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:29.532735 969 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:50:29.534375 969 webserver.cc:460] Webserver started at http://127.23.131.66:39605/ using document root <none> and password file <none>
I20260809 22:50:29.535175 969 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:29.535380 969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:29.535709 969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:29.538832 969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "d45a16e70df84cf793d3bc960b22a3e0"
format_stamp: "Formatted at 2026-08-09 22:50:29 on dist-test-slave-92m1"
server_key: "e2105adbb995cd1194973092bc3d4741"
server_key_iv: "fa03a5cd97aa6aee750ec0e208751879"
server_key_version: "encryptionkey@0"
I20260809 22:50:29.539678 969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "d45a16e70df84cf793d3bc960b22a3e0"
format_stamp: "Formatted at 2026-08-09 22:50:29 on dist-test-slave-92m1"
server_key: "e2105adbb995cd1194973092bc3d4741"
server_key_iv: "fa03a5cd97aa6aee750ec0e208751879"
server_key_version: "encryptionkey@0"
I20260809 22:50:29.547719 969 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260809 22:50:29.552541 993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:29.554159 969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260809 22:50:29.554348 969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "d45a16e70df84cf793d3bc960b22a3e0"
format_stamp: "Formatted at 2026-08-09 22:50:29 on dist-test-slave-92m1"
server_key: "e2105adbb995cd1194973092bc3d4741"
server_key_iv: "fa03a5cd97aa6aee750ec0e208751879"
server_key_version: "encryptionkey@0"
I20260809 22:50:29.554582 969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:29.570828 969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:29.574954 969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:29.575325 969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:29.576331 969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:29.577692 969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:29.577766 969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:29.577939 969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:29.578001 969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:29.612991 969 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46583
I20260809 22:50:29.613073 1181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46583 every 8 connection(s)
I20260809 22:50:29.614329 969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:29.615466 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 969
I20260809 22:50:29.615696 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:29.616291 24077 external_mini_cluster.cc:1428] Setting key c83a70f193bfe73bbebd1ab896176d6b
Aug 09 22:50:29 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315829, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:29.639878 1186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:29.617340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:43463 (local address 127.23.131.126:42883)
0809 22:50:29.617858 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:29.617863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:29.618986 (+ 1123us) server_negotiation.cc:407] Connection header received
0809 22:50:29.621923 (+ 2937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:29.621927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:29.622000 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:29.622093 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:29.624203 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.624927 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.627463 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.627904 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.628007 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:29.632462 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:29.632471 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:29.632479 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:29.632525 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:29.636391 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:29.637143 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:29.637152 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:29.637158 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:29.637325 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:29.637738 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:29.637745 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:29.637751 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:29.638212 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:29.638372 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:29.639052 (+ 680us) server_negotiation.cc:299] Negotiation successful
0809 22:50:29.639365 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":290,"threads_started":1}
I20260809 22:50:29.640702 1187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:29.617890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:42883 (local address 127.23.131.66:43463)
0809 22:50:29.618814 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:29.618864 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:29.621617 (+ 2753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:29.622373 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:29.622387 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:29.623181 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:29.624026 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:29.624053 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.625101 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.625109 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:29.627292 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:29.627311 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:29.628145 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:29.628155 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:29.628494 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:29.629297 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:29.629333 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:29.632200 (+ 2867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:29.636527 (+ 4327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:29.636535 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:29.636548 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:29.636986 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:29.637432 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:29.637435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:29.637437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:29.637623 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:29.638337 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:29.638342 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:29.638669 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 22:50:29.638897 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 22:50:29.639389 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":396,"threads_started":1}
I20260809 22:50:29.642390 1182 heartbeater.cc:347] Connected to a master server at 127.23.131.126:42883
I20260809 22:50:29.642701 1182 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:29.643580 1182 heartbeater.cc:511] Master 127.23.131.126:42883 requested a full tablet report, sending...
I20260809 22:50:29.645268 638 ts_manager.cc:194] Registered new tserver with Master: d45a16e70df84cf793d3bc960b22a3e0 (127.23.131.66:46583)
I20260809 22:50:29.646636 638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:43463
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:50:29.686260 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:42883
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:30.035763 1192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:30.036131 1192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:30.036309 1192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:30.043877 1192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:30.044051 1192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:30.044240 1192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:30.054931 1192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:42883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:30.056248 1192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:30.057610 1192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:30.071170 1205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:30.071192 1206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:30.071117 1211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:30.072216 1192 server_base.cc:1034] running on GCE node
I20260809 22:50:30.072865 1192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:30.073911 1192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:30.075162 1192 hybrid_clock.cc:648] HybridClock initialized: now 1786315830075109 us; error 72 us; skew 500 ppm
I20260809 22:50:30.075536 1192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.078830 1192 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:50:30.080438 1192 webserver.cc:460] Webserver started at http://127.23.131.67:35893/ using document root <none> and password file <none>
I20260809 22:50:30.081141 1192 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:30.081300 1192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:30.081624 1192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:30.084769 1192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "6bc10dfb7d944536894dcdd415f00944"
format_stamp: "Formatted at 2026-08-09 22:50:30 on dist-test-slave-92m1"
server_key: "67f89e052ea3b5118e91b63f0a719d49"
server_key_iv: "08a12120c8fe605f4f41d79156a6eb32"
server_key_version: "encryptionkey@0"
I20260809 22:50:30.085583 1192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "6bc10dfb7d944536894dcdd415f00944"
format_stamp: "Formatted at 2026-08-09 22:50:30 on dist-test-slave-92m1"
server_key: "67f89e052ea3b5118e91b63f0a719d49"
server_key_iv: "08a12120c8fe605f4f41d79156a6eb32"
server_key_version: "encryptionkey@0"
I20260809 22:50:30.089643 962 heartbeater.cc:503] Master 127.23.131.126:42883 was elected leader, sending a full tablet report...
I20260809 22:50:30.091152 1192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 22:50:30.094897 1224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:30.096329 1192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:30.096505 1192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "6bc10dfb7d944536894dcdd415f00944"
format_stamp: "Formatted at 2026-08-09 22:50:30 on dist-test-slave-92m1"
server_key: "67f89e052ea3b5118e91b63f0a719d49"
server_key_iv: "08a12120c8fe605f4f41d79156a6eb32"
server_key_version: "encryptionkey@0"
I20260809 22:50:30.096720 1192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:30.161070 1192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:30.165179 1192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:30.165482 1192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:30.166615 1192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:30.168145 1192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:30.168226 1192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:30.168398 1192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:30.168452 1192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:30.203406 1192 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:39933
I20260809 22:50:30.203442 1401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:39933 every 8 connection(s)
I20260809 22:50:30.204737 1192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:30.206864 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 1192
I20260809 22:50:30.207073 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:30.207710 24077 external_mini_cluster.cc:1428] Setting key 4dd2b42f04899f3ba4bb9c15205bb763
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:30.226306 1404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.207645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:55109 (local address 127.23.131.126:42883)
0809 22:50:30.211516 (+ 3871us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.211520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.211537 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:50:30.212155 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.212159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.212239 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.212325 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.213805 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.214606 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.216194 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.216578 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.216676 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.220219 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.220224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.220227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.220268 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.223586 (+ 3318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.224258 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.224262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.224264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.224385 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.224762 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.224765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.224767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.225041 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.225157 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.225816 (+ 659us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.226000 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3771,"thread_start_us":3664,"threads_started":1}
I20260809 22:50:30.227298 1409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.208113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:42883 (local address 127.23.131.67:55109)
0809 22:50:30.209119 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:30.209190 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:30.211921 (+ 2731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:30.212535 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:30.212542 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:30.213079 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:30.213657 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:30.213674 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.214742 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.214746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:30.216073 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:30.216085 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.216768 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.216772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:30.216962 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.217684 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:30.217707 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:30.220002 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:30.223706 (+ 3704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:30.223713 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:30.223725 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:30.224153 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:30.224476 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:30.224478 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:30.224481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:30.224662 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:30.225147 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:30.225153 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:30.225457 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 22:50:30.225688 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 22:50:30.226084 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":385,"threads_started":1}
I20260809 22:50:30.228772 1402 heartbeater.cc:347] Connected to a master server at 127.23.131.126:42883
I20260809 22:50:30.229041 1402 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:30.229738 1402 heartbeater.cc:511] Master 127.23.131.126:42883 requested a full tablet report, sending...
I20260809 22:50:30.231279 638 ts_manager.cc:194] Registered new tserver with Master: 6bc10dfb7d944536894dcdd415f00944 (127.23.131.67:39933)
I20260809 22:50:30.232084 638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:55109
I20260809 22:50:30.235903 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/test-admin.keytab.
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.272861 24077 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 22:50:30.278450 1414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:30.275890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37868 (local address 127.23.131.65:42699)
0809 22:50:30.276531 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.276539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.276565 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:50:30.276631 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.276638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.276846 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.276980 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.277919 (+ 939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37868: BlockingRecv error: recv got EOF from 127.0.0.1:37868 (error 108)
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":318,"threads_started":1}
W20260809 22:50:30.278488 24077 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc' of type FILE
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.280367 24077 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.281833 24077 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:30.297634 1414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.283603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37878 (local address 127.23.131.65:42699)
0809 22:50:30.283809 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.283815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.283902 (+ 87us) server_negotiation.cc:407] Connection header received
0809 22:50:30.284078 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.284082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.284138 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.284217 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.285212 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.286333 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.287666 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.288259 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.288376 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.292151 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.292163 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.292178 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.292211 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.295096 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.295771 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.295778 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.295780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.295907 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.296246 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.296249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.296251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.296586 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.296804 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.297074 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.297360 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 22:50:30.304013 1414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:30.301935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.23.131.65:42699)
0809 22:50:30.302173 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.302180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.302410 (+ 230us) server_negotiation.cc:407] Connection header received
0809 22:50:30.302602 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.302607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.302673 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.302768 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.303747 (+ 979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37890: BlockingRecv error: recv got EOF from 127.0.0.1:37890 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260809 22:50:30.304239 24077 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc' of type FILE
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.305810 24077 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.307181 24077 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:30.321949 1414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.308488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37900 (local address 127.23.131.65:42699)
0809 22:50:30.308705 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.308711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.308970 (+ 259us) server_negotiation.cc:407] Connection header received
0809 22:50:30.309109 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.309113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.309168 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.309247 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.310294 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.310991 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.312202 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.312651 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.312756 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.316738 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.316743 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.316746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.316782 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.319589 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.320290 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.320295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.320297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.320425 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.320791 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.320795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.320797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.321079 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.321292 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.321554 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.321724 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 22:50:30.326735 1414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:30.324806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37914 (local address 127.23.131.65:42699)
0809 22:50:30.325028 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.325036 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.325292 (+ 256us) server_negotiation.cc:407] Connection header received
0809 22:50:30.325516 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.325521 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.325604 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.325703 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.326471 (+ 768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37914: BlockingRecv error: recv got EOF from 127.0.0.1:37914 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 22:50:30.326958 24077 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786315774646092-24077-0/krb5kdc/krb5cc' of type FILE
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.328701 24077 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:30.330212 24077 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:30.346259 1414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.331712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37924 (local address 127.23.131.65:42699)
0809 22:50:30.331941 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.331947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.332237 (+ 290us) server_negotiation.cc:407] Connection header received
0809 22:50:30.332374 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.332378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.332437 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.332529 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.333578 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.334319 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.335737 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.336221 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.336319 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.340502 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.340508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.340512 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.340550 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.343393 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.344104 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.344110 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.344114 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.344274 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.344778 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.344784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.344791 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.345080 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.345434 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.345687 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.345924 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 22:50:30.348028 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 746
I20260809 22:50:30.360782 1414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.348884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37926 (local address 127.23.131.65:42699)
0809 22:50:30.349087 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.349091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.349457 (+ 366us) server_negotiation.cc:407] Connection header received
0809 22:50:30.349538 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.349542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.349611 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.349705 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.350688 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.351540 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.352755 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.353186 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.353280 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.355719 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.355723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.355727 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.355763 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.358443 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.359106 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.359110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.359112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.359309 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.359646 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.359649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.359651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.359909 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.360122 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.360353 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.360516 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 22:50:30.361423 955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:30.449627 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 746
I20260809 22:50:30.478395 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 969
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:50:30.494529 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.479556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50130 (local address 127.23.131.66:46583)
0809 22:50:30.480137 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.480144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.480170 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:50:30.480235 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.480242 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.480452 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.480586 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.481553 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.482585 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.484155 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.484720 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.484828 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.488752 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.488765 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.488781 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.488819 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.491857 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.492585 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.492592 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.492595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.492740 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.493071 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.493075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.493077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.493443 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.493670 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.493976 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.494205 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":289,"threads_started":1}
I20260809 22:50:30.496114 1174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:30.581966 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 969
I20260809 22:50:30.604915 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 1192
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:50:30.621915 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:30.605972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53098 (local address 127.23.131.67:39933)
0809 22:50:30.606517 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:30.606526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:30.606558 (+ 32us) server_negotiation.cc:407] Connection header received
0809 22:50:30.606624 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:30.606631 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:30.606850 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:30.607050 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:30.608269 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.609360 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.610736 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:30.611682 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:30.611790 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:30.616081 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:30.616096 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:30.616111 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:30.616157 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:30.618995 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.619855 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.619863 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.619865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.620000 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:30.620439 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:30.620442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:30.620444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:30.620806 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:30.621054 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:30.621294 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 22:50:30.621551 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":248,"threads_started":1}
I20260809 22:50:30.623414 1394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:30.708727 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 1192
I20260809 22:50:30.734179 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 595
I20260809 22:50:30.735576 696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:30.845144 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 595
2026-08-09T22:50:30Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4593 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[1442](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[1442](info): set up 2 sockets
Aug 09 22:50:30 dist-test-slave-92m1 krb5kdc[1442](info): commencing operation
krb5kdc: starting...
W20260809 22:50:32.210189 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:32 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:32Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab.
Entry for principal oryx/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab.
I20260809 22:50:32.516741 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39199
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab
--principal=oryx/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39199
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:32.874241 1466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:32.874570 1466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:32.874763 1466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:32.882217 1466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:32.882335 1466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:32.882431 1466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:32.882543 1466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:32.882628 1466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:32.892953 1466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab
--principal=oryx/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:32.894388 1466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:32.895773 1466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:32.908241 1475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:32.908272 1476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:32.908872 1479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:32.909267 1466 server_base.cc:1034] running on GCE node
I20260809 22:50:32.910037 1466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:32.911484 1466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:32.912739 1466 hybrid_clock.cc:648] HybridClock initialized: now 1786315832912701 us; error 42 us; skew 500 ppm
I20260809 22:50:32.913089 1466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:32 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:32.916388 1466 init.cc:377] Logged in from keytab as oryx/127.23.131.126@KRBTEST.COM (short username oryx)
I20260809 22:50:32.917842 1466 webserver.cc:460] Webserver started at http://127.23.131.126:41775/ using document root <none> and password file <none>
I20260809 22:50:32.918521 1466 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:32.918665 1466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:32.918982 1466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:32.921988 1466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "5f98f8157bcb4ce7800125df30f229f8"
format_stamp: "Formatted at 2026-08-09 22:50:32 on dist-test-slave-92m1"
server_key: "a5a7925eb24362e2aa27718dd44139b1"
server_key_iv: "036f57c0d294ceb1f46be4a76008da46"
server_key_version: "encryptionkey@0"
I20260809 22:50:32.922753 1466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "5f98f8157bcb4ce7800125df30f229f8"
format_stamp: "Formatted at 2026-08-09 22:50:32 on dist-test-slave-92m1"
server_key: "a5a7925eb24362e2aa27718dd44139b1"
server_key_iv: "036f57c0d294ceb1f46be4a76008da46"
server_key_version: "encryptionkey@0"
I20260809 22:50:32.928009 1466 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:50:32.931362 1490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:32.932653 1466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:50:32.932839 1466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "5f98f8157bcb4ce7800125df30f229f8"
format_stamp: "Formatted at 2026-08-09 22:50:32 on dist-test-slave-92m1"
server_key: "a5a7925eb24362e2aa27718dd44139b1"
server_key_iv: "036f57c0d294ceb1f46be4a76008da46"
server_key_version: "encryptionkey@0"
I20260809 22:50:32.933032 1466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:32.948168 1466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:32.952942 1466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:32.953352 1466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:32.974130 1466 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:39199
I20260809 22:50:32.974154 1586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:39199 every 8 connection(s)
I20260809 22:50:32.975793 1466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:32.976531 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 1466
I20260809 22:50:32.976783 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:32.977546 24077 external_mini_cluster.cc:1428] Setting key 8f8db874986948c8800d5ba7fe6b139b
I20260809 22:50:32.980752 1589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:50:32 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:32.995711 1589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Bootstrap starting.
I20260809 22:50:33.000223 1589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:33.001473 1589 log.cc:824] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:33.004526 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:32.979924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45670 (local address 127.23.131.126:39199)
0809 22:50:32.980870 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:32.980910 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:32.980968 (+ 58us) server_negotiation.cc:407] Connection header received
0809 22:50:32.982656 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:32.982679 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:32.983066 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:32.983490 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:32.985554 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:32.987013 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:32.988958 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:32.989725 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:32.989872 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:32.995161 (+ 5289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:32.995173 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:32.995227 (+ 54us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:32.995293 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:32.999528 (+ 4235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:33.000419 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:33.000427 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:33.000433 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:33.000638 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:33.001123 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:33.001135 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:33.001138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:33.001781 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:33.002136 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:33.002604 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 22:50:33.003111 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":440,"threads_started":1}
I20260809 22:50:33.005285 1589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: No bootstrap required, opened a new log
I20260809 22:50:33.013509 1589 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } }
I20260809 22:50:33.013914 1589 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:33.013989 1589 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f98f8157bcb4ce7800125df30f229f8, State: Initialized, Role: FOLLOWER
I20260809 22:50:33.014585 1589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } }
I20260809 22:50:33.014809 1589 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:33.014912 1589 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:33.015049 1589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:33.017645 1589 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } }
I20260809 22:50:33.018129 1589 leader_election.cc:302] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f98f8157bcb4ce7800125df30f229f8; no voters:
I20260809 22:50:33.018728 1589 leader_election.cc:288] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:33.018908 1598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:33.019796 1598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5f98f8157bcb4ce7800125df30f229f8, State: Running, Role: LEADER
I20260809 22:50:33.020426 1598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } }
I20260809 22:50:33.021116 1589 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:33.023813 1599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } }
I20260809 22:50:33.023840 1600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f98f8157bcb4ce7800125df30f229f8. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } }
I20260809 22:50:33.024328 1599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:33.024379 1600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:33.025279 1607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:33.034711 1607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:33.044054 1607 catalog_manager.cc:1347] Generated new cluster ID: 9c762ffd42c041bbbd17237e77cd20a7
I20260809 22:50:33.044243 1607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:33.064405 1607 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:33.066442 1607 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:33.085657 1607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Generated new TSK 0
I20260809 22:50:33.086943 1607 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab.
Entry for principal oryx/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab.
I20260809 22:50:33.174445 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39199
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:33.535959 1626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:33.536288 1626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:33.536486 1626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:33.547049 1626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:33.547235 1626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:33.547458 1626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:33.558333 1626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:33.559828 1626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:33.561288 1626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:33.575320 1638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:33.575348 1639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:33.575577 1641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:33.576234 1626 server_base.cc:1034] running on GCE node
I20260809 22:50:33.576874 1626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:33.577899 1626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:33.579134 1626 hybrid_clock.cc:648] HybridClock initialized: now 1786315833579085 us; error 60 us; skew 500 ppm
I20260809 22:50:33.579496 1626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:33 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315833, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:33.586458 1626 init.cc:377] Logged in from keytab as oryx/127.23.131.65@KRBTEST.COM (short username oryx)
I20260809 22:50:33.588109 1626 webserver.cc:460] Webserver started at http://127.23.131.65:39169/ using document root <none> and password file <none>
I20260809 22:50:33.588841 1626 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:33.588965 1626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:33.589234 1626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:33.592335 1626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "06f078d4f0c8485aa34bb06ad7063052"
format_stamp: "Formatted at 2026-08-09 22:50:33 on dist-test-slave-92m1"
server_key: "48b91c67d1202e5aafd2f420f0105fde"
server_key_iv: "c7b36f188c11f3b93a430f7299ee3b66"
server_key_version: "encryptionkey@0"
I20260809 22:50:33.593124 1626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "06f078d4f0c8485aa34bb06ad7063052"
format_stamp: "Formatted at 2026-08-09 22:50:33 on dist-test-slave-92m1"
server_key: "48b91c67d1202e5aafd2f420f0105fde"
server_key_iv: "c7b36f188c11f3b93a430f7299ee3b66"
server_key_version: "encryptionkey@0"
I20260809 22:50:33.598519 1626 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:33.602319 1651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:33.603822 1626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:50:33.603978 1626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "06f078d4f0c8485aa34bb06ad7063052"
format_stamp: "Formatted at 2026-08-09 22:50:33 on dist-test-slave-92m1"
server_key: "48b91c67d1202e5aafd2f420f0105fde"
server_key_iv: "c7b36f188c11f3b93a430f7299ee3b66"
server_key_version: "encryptionkey@0"
I20260809 22:50:33.604167 1626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:33.621305 1626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:33.625797 1626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:33.626155 1626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:33.627385 1626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:33.628850 1626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:33.628934 1626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:33.629082 1626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:33.629145 1626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:33.665068 1626 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:33823
I20260809 22:50:33.665113 1849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:33823 every 8 connection(s)
I20260809 22:50:33.666424 1626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:33.676133 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 1626
I20260809 22:50:33.676359 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:33.677059 24077 external_mini_cluster.cc:1428] Setting key 6293364dfb0a047085f8de0ada3a75f4
Aug 09 22:50:33 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315833, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:33.690689 1854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:33.669457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:41365 (local address 127.23.131.126:39199)
0809 22:50:33.669962 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:33.669967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:33.670883 (+ 916us) server_negotiation.cc:407] Connection header received
0809 22:50:33.672915 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:33.672922 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:33.673036 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:33.673166 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:33.674787 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:33.675677 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:33.677510 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:33.678116 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:33.678279 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:33.682836 (+ 4557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:33.682846 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:33.682854 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:33.682914 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:33.686826 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:33.687839 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:33.687848 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:33.687854 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:33.688044 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:33.688511 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:33.688518 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:33.688524 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:33.688960 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:33.689154 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:33.689914 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 22:50:33.690198 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":268,"threads_started":1}
I20260809 22:50:33.691488 1855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:33.669916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:41365)
0809 22:50:33.670689 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:33.670737 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:33.672599 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:33.673438 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:33.673448 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:33.674018 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:33.674599 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:33.674617 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:33.675869 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:33.675873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:33.677344 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:33.677358 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:33.678388 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:33.678394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:33.678615 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:33.679533 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:33.679565 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:33.682555 (+ 2990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:33.687042 (+ 4487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:33.687052 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:33.687068 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:33.687694 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:33.688170 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:33.688173 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:33.688175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:33.688385 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:33.689085 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:33.689092 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:33.689472 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 22:50:33.689728 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 22:50:33.690171 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":311,"threads_started":1}
I20260809 22:50:33.693445 1851 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39199
I20260809 22:50:33.693813 1851 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:33.694638 1851 heartbeater.cc:511] Master 127.23.131.126:39199 requested a full tablet report, sending...
I20260809 22:50:33.697012 1525 ts_manager.cc:194] Registered new tserver with Master: 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823)
I20260809 22:50:33.698530 1525 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:41365
WARNING: no policy specified for oryx/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab.
Entry for principal oryx/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab.
I20260809 22:50:33.746063 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39199
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:34.099924 1859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:34.100242 1859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:34.100342 1859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:34.108076 1859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:34.108235 1859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:34.108392 1859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:34.118700 1859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:34.120121 1859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:34.121459 1859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:34.136210 1865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:34.136166 1867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:34.136276 1864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:34.137029 1859 server_base.cc:1034] running on GCE node
I20260809 22:50:34.137652 1859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:34.138679 1859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:34.139894 1859 hybrid_clock.cc:648] HybridClock initialized: now 1786315834139829 us; error 60 us; skew 500 ppm
I20260809 22:50:34.140242 1859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:34 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315834, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:34.143518 1859 init.cc:377] Logged in from keytab as oryx/127.23.131.66@KRBTEST.COM (short username oryx)
I20260809 22:50:34.144939 1859 webserver.cc:460] Webserver started at http://127.23.131.66:34239/ using document root <none> and password file <none>
I20260809 22:50:34.145650 1859 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:34.145790 1859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:34.146136 1859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:34.149214 1859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "d57511cff5c042b88bcf92f43e96dbe8"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "9e7101c261a3dd6bfcfc67f230cd33f6"
server_key_iv: "54d0419b2a58ca739a251addc7f2bdae"
server_key_version: "encryptionkey@0"
I20260809 22:50:34.150048 1859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "d57511cff5c042b88bcf92f43e96dbe8"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "9e7101c261a3dd6bfcfc67f230cd33f6"
server_key_iv: "54d0419b2a58ca739a251addc7f2bdae"
server_key_version: "encryptionkey@0"
I20260809 22:50:34.155711 1859 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:50:34.159308 1877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:34.160653 1859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:34.160826 1859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "d57511cff5c042b88bcf92f43e96dbe8"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "9e7101c261a3dd6bfcfc67f230cd33f6"
server_key_iv: "54d0419b2a58ca739a251addc7f2bdae"
server_key_version: "encryptionkey@0"
I20260809 22:50:34.161067 1859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:34.175850 1859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:34.179780 1859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:34.180078 1859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:34.181032 1859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:34.182382 1859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:34.182457 1859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:34.182642 1859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:34.182694 1859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:34.218333 1859 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:38853
I20260809 22:50:34.218372 2057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:38853 every 8 connection(s)
I20260809 22:50:34.219827 1859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:34.227739 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 1859
I20260809 22:50:34.227962 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:34.228516 24077 external_mini_cluster.cc:1428] Setting key b45b2be84b89f741d6d64dd81ae719dc
Aug 09 22:50:34 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315834, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:34.242918 2063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:34.222520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:40673 (local address 127.23.131.126:39199)
0809 22:50:34.223000 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:34.223012 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:34.224199 (+ 1187us) server_negotiation.cc:407] Connection header received
0809 22:50:34.226088 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:34.226097 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:34.226202 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:34.226307 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:34.228276 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.229137 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.230927 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.231657 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.231805 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:34.235436 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:34.235445 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:34.235453 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:34.235501 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:34.239336 (+ 3835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:34.240150 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:34.240158 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:34.240165 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:34.240343 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:34.240785 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:34.240792 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:34.240799 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:34.241198 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:34.241396 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:34.242124 (+ 728us) server_negotiation.cc:299] Negotiation successful
0809 22:50:34.242400 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":235,"threads_started":1}
I20260809 22:50:34.243611 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:34.223174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:40673)
0809 22:50:34.224016 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:34.224058 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:34.225744 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:34.226538 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:34.226546 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:34.227110 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:34.228064 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:34.228095 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.229328 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.229333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:34.230773 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:34.230785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.231874 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.231879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:34.232103 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:34.232861 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:34.232885 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:34.235143 (+ 2258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:34.239496 (+ 4353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:34.239510 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:34.239526 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:34.240002 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:34.240454 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:34.240458 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:34.240460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:34.240666 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:34.241324 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:34.241331 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:34.241719 (+ 388us) client_negotiation.cc:769] Sending connection context
0809 22:50:34.241956 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 22:50:34.242380 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":303,"threads_started":1}
I20260809 22:50:34.245527 2058 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39199
I20260809 22:50:34.245900 2058 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:34.246703 2058 heartbeater.cc:511] Master 127.23.131.126:39199 requested a full tablet report, sending...
I20260809 22:50:34.248373 1525 ts_manager.cc:194] Registered new tserver with Master: d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:34.249215 1525 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:40673
WARNING: no policy specified for oryx/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab.
Entry for principal oryx/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab.
I20260809 22:50:34.294351 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39199
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:34.651647 2071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:34.652011 2071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:34.652204 2071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:34.659997 2071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:34.660159 2071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:34.660334 2071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:34.670715 2071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:34.672091 2071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:34.673419 2071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:34.687124 2085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:34.687238 2080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:34.687165 2079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:34.692723 2071 server_base.cc:1034] running on GCE node
I20260809 22:50:34.693399 2071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:34.694404 2071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:34.695647 2071 hybrid_clock.cc:648] HybridClock initialized: now 1786315834695589 us; error 70 us; skew 500 ppm
I20260809 22:50:34.695989 2071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:50:34.701807 1851 heartbeater.cc:503] Master 127.23.131.126:39199 was elected leader, sending a full tablet report...
Aug 09 22:50:34 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315834, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:34.703137 2071 init.cc:377] Logged in from keytab as oryx/127.23.131.67@KRBTEST.COM (short username oryx)
I20260809 22:50:34.705054 2071 webserver.cc:460] Webserver started at http://127.23.131.67:46427/ using document root <none> and password file <none>
I20260809 22:50:34.705834 2071 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:34.706003 2071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:34.706349 2071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:34.709983 2071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "0ef6a043d74449919221b6ae22950649"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "fec41aeda091127c244b72687fa4ebb9"
server_key_iv: "8e146808ac4c0ed6a075d30b9eef3706"
server_key_version: "encryptionkey@0"
I20260809 22:50:34.710871 2071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "0ef6a043d74449919221b6ae22950649"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "fec41aeda091127c244b72687fa4ebb9"
server_key_iv: "8e146808ac4c0ed6a075d30b9eef3706"
server_key_version: "encryptionkey@0"
I20260809 22:50:34.716741 2071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 22:50:34.720371 2094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:34.721823 2071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 22:50:34.722016 2071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "0ef6a043d74449919221b6ae22950649"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "fec41aeda091127c244b72687fa4ebb9"
server_key_iv: "8e146808ac4c0ed6a075d30b9eef3706"
server_key_version: "encryptionkey@0"
I20260809 22:50:34.722260 2071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:34.740569 2071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:34.745177 2071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:34.745503 2071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:34.746599 2071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:34.748131 2071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:34.748236 2071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:34.748390 2071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:34.748466 2071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:34.784026 2071 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:46073
I20260809 22:50:34.784087 2285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:46073 every 8 connection(s)
I20260809 22:50:34.785393 2071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:34.787370 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 2071
I20260809 22:50:34.787583 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:34.788106 24077 external_mini_cluster.cc:1428] Setting key d4ee30c78abb38560e615842558ec193
Aug 09 22:50:34 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315834, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:34.806463 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:34.788180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:37931 (local address 127.23.131.126:39199)
0809 22:50:34.788733 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:34.788739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:34.789843 (+ 1104us) server_negotiation.cc:407] Connection header received
0809 22:50:34.792195 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:34.792199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:34.792273 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:34.792366 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:34.793891 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.794670 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.796315 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.796696 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.796790 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:34.800354 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:34.800359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:34.800362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:34.800396 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:34.803368 (+ 2972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:34.804170 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:34.804174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:34.804189 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:34.804407 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:34.804879 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:34.804882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:34.804884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:34.805172 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:34.805295 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:34.805980 (+ 685us) server_negotiation.cc:299] Negotiation successful
0809 22:50:34.806181 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":263,"threads_started":1}
I20260809 22:50:34.807530 2291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:34.788862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:37931)
0809 22:50:34.789690 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:34.789745 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:34.791942 (+ 2197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:34.792584 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:34.792592 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:34.793172 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:34.793737 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:34.793753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.794803 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.794806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:34.796193 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:34.796206 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:34.796875 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:34.796880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:34.797101 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:34.797766 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:34.797788 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:34.800149 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:34.803531 (+ 3382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:34.803542 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:34.803561 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:34.804050 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:34.804540 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:34.804544 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:34.804546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:34.804770 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:34.805279 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:34.805285 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:34.805629 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 22:50:34.805852 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 22:50:34.806273 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":354,"threads_started":1}
I20260809 22:50:34.808876 2286 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39199
I20260809 22:50:34.809237 2286 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:34.809993 2286 heartbeater.cc:511] Master 127.23.131.126:39199 requested a full tablet report, sending...
I20260809 22:50:34.811439 1525 ts_manager.cc:194] Registered new tserver with Master: 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073)
I20260809 22:50:34.812227 1525 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:37931
I20260809 22:50:34.816659 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.131.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.125.keytab.
Entry for principal oryx/127.23.131.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.125.keytab.
I20260809 22:50:34.882680 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:45835
--webserver_interface=127.23.131.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.125.keytab
--principal=oryx/127.23.131.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39199,127.23.131.125:45835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:50:35.251933 2058 heartbeater.cc:503] Master 127.23.131.126:39199 was elected leader, sending a full tablet report...
W20260809 22:50:35.254601 2298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:35.254938 2298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:35.255098 2298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:35.262667 2298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:35.262825 2298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:35.262929 2298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:35.263034 2298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:35.263123 2298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:35.273931 2298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39199,127.23.131.125:45835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.125.keytab
--principal=oryx/127.23.131.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:45835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.131.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
W20260809 22:50:35.274390 2298 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.23.131.126:39199,127.23.131.125:45835'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 22:50:35.275538 2298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:35.276973 2298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:35.289872 2306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:35.289849 2311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:35.289816 2305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:35.290637 2298 server_base.cc:1034] running on GCE node
I20260809 22:50:35.291507 2298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:35.292996 2298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:35.294257 2298 hybrid_clock.cc:648] HybridClock initialized: now 1786315835294191 us; error 43 us; skew 500 ppm
I20260809 22:50:35.294593 2298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:35 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315835, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:35.297901 2298 init.cc:377] Logged in from keytab as oryx/127.23.131.125@KRBTEST.COM (short username oryx)
I20260809 22:50:35.299467 2298 webserver.cc:460] Webserver started at http://127.23.131.125:37187/ using document root <none> and password file <none>
I20260809 22:50:35.300259 2298 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:35.300395 2298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:35.300721 2298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:35.303795 2298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/instance:
uuid: "36ebe0117f0d431e81a329b235a775c0"
format_stamp: "Formatted at 2026-08-09 22:50:35 on dist-test-slave-92m1"
server_key: "7dc7a25c781e784e58fc235a6eb4ab74"
server_key_iv: "6f9962cf63b6b26c8344bc4cc52e9e04"
server_key_version: "encryptionkey@0"
I20260809 22:50:35.304605 2298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal/instance:
uuid: "36ebe0117f0d431e81a329b235a775c0"
format_stamp: "Formatted at 2026-08-09 22:50:35 on dist-test-slave-92m1"
server_key: "7dc7a25c781e784e58fc235a6eb4ab74"
server_key_iv: "6f9962cf63b6b26c8344bc4cc52e9e04"
server_key_version: "encryptionkey@0"
I20260809 22:50:35.310174 2298 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:50:35.313678 2320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:35.314956 2298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:50:35.315150 2298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
uuid: "36ebe0117f0d431e81a329b235a775c0"
format_stamp: "Formatted at 2026-08-09 22:50:35 on dist-test-slave-92m1"
server_key: "7dc7a25c781e784e58fc235a6eb4ab74"
server_key_iv: "6f9962cf63b6b26c8344bc4cc52e9e04"
server_key_version: "encryptionkey@0"
I20260809 22:50:35.315423 2298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:35.338882 2298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:35.343462 2298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:35.343760 2298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:35.363103 2298 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.125:45835
I20260809 22:50:35.363111 2394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.125:45835 every 8 connection(s)
I20260809 22:50:35.364610 2298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
I20260809 22:50:35.368383 2395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:35.371544 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 2298
I20260809 22:50:35.375977 2395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:50:35 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
Aug 09 22:50:35 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315835, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.125@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:35.395829 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.378648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35424 (local address 127.23.131.126:39199)
0809 22:50:35.379933 (+ 1285us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.379940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.379959 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:50:35.380028 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.380033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.380117 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.380232 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.381356 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.382453 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.384519 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.385204 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.385359 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.388857 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.388861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.388864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.388935 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.392340 (+ 3405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.393170 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.393173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.393176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.393346 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.393718 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.393723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.393726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.394190 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.394343 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.395198 (+ 855us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.395462 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1158,"thread_start_us":1029,"threads_started":1}
I20260809 22:50:35.396341 2401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.373712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53724 (local address 127.23.131.125:45835)
0809 22:50:35.374472 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.374483 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.374524 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:50:35.376284 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.376307 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.376700 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.377090 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.378726 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.380723 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.382322 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.383327 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.383513 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.388218 (+ 4705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.388226 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.388237 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.388267 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.391825 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.392625 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.392632 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.392635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.392797 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.393269 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.393275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.393278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.393977 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.394291 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.394656 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.395124 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":351,"threads_started":1}
I20260809 22:50:35.396425 2402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.378508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35424)
0809 22:50:35.379277 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:35.379319 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:35.379468 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:35.380308 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:35.380313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:35.380931 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:35.381199 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.381208 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.382574 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.382580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.384370 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.384382 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.385415 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.385420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.385546 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.386137 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:35.386167 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:35.388657 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:35.392473 (+ 3816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.392485 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.392497 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.393045 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.393463 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.393466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.393468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.393599 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.394330 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:35.394339 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:35.394602 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 22:50:35.394843 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 22:50:35.395312 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":100,"thread_start_us":296,"threads_started":1}
I20260809 22:50:35.398845 2395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:50:35 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315835, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.125@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
I20260809 22:50:35.411062 2402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.399819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53736)
0809 22:50:35.399997 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:35.400137 (+ 140us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:35.400234 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:35.400487 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:35.400490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:35.400800 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:35.400938 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.400945 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.401849 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.401852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.402709 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.402719 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.403425 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.403430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.403602 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.404196 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:35.404214 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:35.406161 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:35.409027 (+ 2866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.409031 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.409034 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.409437 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.409762 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.409765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.409767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.409900 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.410363 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:35.410366 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:35.410493 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 22:50:35.410604 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 22:50:35.410803 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 22:50:35.411244 2401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.400031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53736 (local address 127.23.131.125:45835)
0809 22:50:35.400173 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.400177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.400191 (+ 14us) server_negotiation.cc:407] Connection header received
0809 22:50:35.400325 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.400328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.400379 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.400453 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.401051 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.401732 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.402823 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.403271 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.403369 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.406329 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.406333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.406336 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.406364 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.408880 (+ 2516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.409545 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.409549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.409551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.409658 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.409988 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.409991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.409993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.410262 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.410369 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.410686 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.410927 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":49}
I20260809 22:50:35.415913 2395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Bootstrap starting.
I20260809 22:50:35.418962 2395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:35.420210 2395 log.cc:824] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:35.422914 2395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: No bootstrap required, opened a new log
I20260809 22:50:35.430114 2395 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } }
I20260809 22:50:35.430410 2395 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:35.430483 2395 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36ebe0117f0d431e81a329b235a775c0, State: Initialized, Role: FOLLOWER
I20260809 22:50:35.431056 2395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } }
I20260809 22:50:35.431893 2409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } } }
I20260809 22:50:35.432242 2409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:50:35.432886 2395 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 22:50:35.442040 2428 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:50:35.442185 2428 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:50:35.444375 2298 master_runner.cc:428] Detected that this master 36ebe0117f0d431e81a329b235a775c0 is joining an existing cluster
I20260809 22:50:35.444482 2298 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.131.125:45835
I20260809 22:50:35.467427 2401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.448729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53744 (local address 127.23.131.125:45835)
0809 22:50:35.448937 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.448946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.449594 (+ 648us) server_negotiation.cc:407] Connection header received
0809 22:50:35.449839 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.449849 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.449919 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.450002 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.451565 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.452752 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.454806 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.455609 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.455708 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.458943 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.458951 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.458973 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.459015 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.463584 (+ 4569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.464978 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.464986 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.464996 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.465164 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.465680 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.465686 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.465692 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.466100 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.466253 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.466744 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.466991 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:50:35.467692 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.448786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53744)
0809 22:50:35.449487 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:35.449507 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:35.449701 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:35.450200 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:35.450205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:35.450920 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:35.451396 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.451411 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.452988 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.452994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.454634 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.454650 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.456081 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.456088 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.456251 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.457215 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:35.457246 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:35.458739 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:35.463757 (+ 5018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.463764 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.463770 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.464838 (+ 1068us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.465296 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.465302 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.465308 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.465570 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.466344 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:35.466347 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:35.466464 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 22:50:35.466867 (+ 403us) client_negotiation.cc:240] Negotiation successful
0809 22:50:35.467159 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":378,"threads_started":1}
I20260809 22:50:35.475886 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.448741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35438 (local address 127.23.131.126:39199)
0809 22:50:35.448925 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.448931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.457089 (+ 8158us) server_negotiation.cc:407] Connection header received
0809 22:50:35.457360 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.457366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.457469 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.457542 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.459158 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.460301 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.462511 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.463187 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.463309 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.465981 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.465989 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.465994 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.466044 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.471184 (+ 5140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.472471 (+ 1287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.472479 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.472485 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.472739 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.473414 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.473423 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.473429 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.474033 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.474219 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.475263 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.475529 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:50:35.476369 2435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.449751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35438)
0809 22:50:35.456969 (+ 7218us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:35.456989 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:35.457201 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:35.457773 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:35.457779 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:35.458577 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:35.458941 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.458958 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.460530 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.460535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.462327 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.462343 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.463604 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.463611 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.463806 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.464385 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:35.464409 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:35.465727 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:35.471380 (+ 5653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.471388 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.471394 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.472277 (+ 883us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.472974 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.472982 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.472988 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.473237 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.474369 (+ 1132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:35.474376 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:35.474782 (+ 406us) client_negotiation.cc:769] Sending connection context
0809 22:50:35.475095 (+ 313us) client_negotiation.cc:240] Negotiation successful
0809 22:50:35.475495 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7061,"thread_start_us":7060,"threads_started":1}
WARNING: no policy specified for oryx/127.23.131.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.124@KRBTEST.COM" created.
Aug 09 22:50:35 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.126@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
I20260809 22:50:35.509789 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.483597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53758)
0809 22:50:35.487877 (+ 4280us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:35.487921 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:35.488196 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:35.488745 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:35.488751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:35.489430 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:35.489657 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.489667 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.491149 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.491153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.492712 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.492730 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.493790 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.493799 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.494060 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.494835 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:35.494863 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:35.498083 (+ 3220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:35.506286 (+ 8203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.506303 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.506311 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.506924 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.507516 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.507521 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.507525 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.507699 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.508512 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:35.508521 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:35.508744 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 22:50:35.508965 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 22:50:35.509338 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3977,"thread_start_us":3791,"threads_started":1}
I20260809 22:50:35.510277 2401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.484146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53758 (local address 127.23.131.125:45835)
0809 22:50:35.484351 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.484357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.488030 (+ 3673us) server_negotiation.cc:407] Connection header received
0809 22:50:35.488445 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.488451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.488570 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.488680 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.489811 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.490961 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.492876 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.493613 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.493748 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.498303 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.498312 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.498319 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.498370 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.506124 (+ 7754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.507147 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.507156 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.507162 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.507373 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.507850 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.507857 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.507863 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.508319 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.508510 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.509120 (+ 610us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.509469 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:50:35.512495 1525 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.131.125:45835: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "36ebe0117f0d431e81a329b235a775c0"
member_type: NON_VOTER
last_known_addr {
host: "127.23.131.125"
port: 45835
}
attrs {
promote: true
}
}
dest_uuid: "5f98f8157bcb4ce7800125df30f229f8"
cas_config_opid_index: -1
I20260809 22:50:35.513741 1525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } }
I20260809 22:50:35.526932 2446 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 36ebe0117f0d431e81a329b235a775c0 (127.23.131.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } }
I20260809 22:50:35.528862 2362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:35.532378 2362 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Refusing update from remote peer 5f98f8157bcb4ce7800125df30f229f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 22:50:35.532415 2446 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.131.125:45835
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.124.keytab.
Entry for principal oryx/127.23.131.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.124.keytab.
I20260809 22:50:35.534026 2298 master.cc:537] Master@127.23.131.125:45835 shutting down...
I20260809 22:50:35.533967 2446 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.001s
I20260809 22:50:35.533313 2447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } }
I20260809 22:50:35.534489 2447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:35.537361 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:37863
--webserver_interface=127.23.131.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.124.keytab
--principal=oryx/127.23.131.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:35.538059 1495 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 22:50:35.553303 1495 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 -> Peer 36ebe0117f0d431e81a329b235a775c0 (127.23.131.125:45835): Couldn't send request to peer 36ebe0117f0d431e81a329b235a775c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 22:50:35.560418 2298 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:35.560963 2298 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:35.561225 2298 tablet_replica.cc:330] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: stopping tablet replica
I20260809 22:50:35.579182 2298 master.cc:552] Master@127.23.131.125:45835 shutdown complete.
I20260809 22:50:35.579360 2298 master_runner.cc:305] Clearing existing system tablet
I20260809 22:50:35.579900 2298 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:35.580004 2298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:35.583097 2298 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 22:50:35.584841 2453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:35.585227 2298 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:35.585522 2298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 22:50:35.585604 2298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
uuid: "36ebe0117f0d431e81a329b235a775c0"
format_stamp: "Formatted at 2026-08-09 22:50:35 on dist-test-slave-92m1"
server_key: "7dc7a25c781e784e58fc235a6eb4ab74"
server_key_iv: "6f9962cf63b6b26c8344bc4cc52e9e04"
server_key_version: "encryptionkey@0"
I20260809 22:50:35.590618 2298 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:35.598006 2298 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 22:50:35.598215 2298 log.cc:1196] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 22:50:35.598699 2298 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Deleting consensus metadata
I20260809 22:50:35.598992 2298 master_runner.cc:315] Copying system tablet from 127.23.131.126:39199
I20260809 22:50:35.601833 2298 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: tablet copy: Beginning tablet copy session from remote peer at address 127.23.131.126:39199
I20260809 22:50:35.619189 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.602762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35454 (local address 127.23.131.126:39199)
0809 22:50:35.602966 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:35.602973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:35.603872 (+ 899us) server_negotiation.cc:407] Connection header received
0809 22:50:35.604065 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:35.604071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:35.604185 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:35.604319 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:35.605448 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.606614 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.608646 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.609515 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.609679 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.612265 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:35.612274 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:35.612278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:35.612320 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:35.615914 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.616824 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.616830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.616834 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.617003 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:35.617463 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:35.617467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:35.617471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:35.617862 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:35.618036 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:35.618566 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 22:50:35.618812 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:50:35.619308 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:35.602701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35454)
0809 22:50:35.603727 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:35.603748 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:35.603916 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:35.604366 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:35.604371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:35.604957 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:35.605254 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.605268 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.606787 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.606793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.608383 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:35.608399 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:35.609721 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:35.609728 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:35.609929 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:35.610742 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:35.610767 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:35.612023 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:35.616098 (+ 4075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.616103 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.616108 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.616668 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.617130 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:35.617137 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:35.617141 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:35.617308 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:35.618010 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:35.618015 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:35.618212 (+ 197us) client_negotiation.cc:769] Sending connection context
0809 22:50:35.618388 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 22:50:35.618740 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":883,"thread_start_us":669,"threads_started":1}
I20260809 22:50:35.620616 1561 tablet_copy_service.cc:140] P 5f98f8157bcb4ce7800125df30f229f8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 36ebe0117f0d431e81a329b235a775c0 ({username='oryx', principal='oryx/127.23.131.125@KRBTEST.COM'} at 127.0.0.1:35454)
I20260809 22:50:35.620937 1561 tablet_copy_service.cc:161] P 5f98f8157bcb4ce7800125df30f229f8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 36ebe0117f0d431e81a329b235a775c0 at {username='oryx', principal='oryx/127.23.131.125@KRBTEST.COM'} at 127.0.0.1:35454: session id = 36ebe0117f0d431e81a329b235a775c0-00000000000000000000000000000000
I20260809 22:50:35.625586 1561 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 22:50:35.628273 2298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 22:50:35.636722 2298 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: tablet copy: Starting download of 0 data blocks...
I20260809 22:50:35.637097 2298 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: tablet copy: Starting download of 1 WAL segments...
I20260809 22:50:35.640349 2298 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 22:50:35.645469 1561 tablet_copy_service.cc:342] P 5f98f8157bcb4ce7800125df30f229f8: Request end of tablet copy session 36ebe0117f0d431e81a329b235a775c0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.131.125@KRBTEST.COM'} at 127.0.0.1:35454
I20260809 22:50:35.645781 1561 tablet_copy_service.cc:433] P 5f98f8157bcb4ce7800125df30f229f8: ending tablet copy session 36ebe0117f0d431e81a329b235a775c0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 36ebe0117f0d431e81a329b235a775c0
I20260809 22:50:35.660331 2298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:35.663267 2466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:35.673496 2472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:35.675601 2467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:35.676966 2298 server_base.cc:1034] running on GCE node
I20260809 22:50:35.677380 2298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:35.678220 2298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:35.679577 2298 hybrid_clock.cc:648] HybridClock initialized: now 1786315835679491 us; error 41 us; skew 500 ppm
I20260809 22:50:35.679867 2298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:35 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315835, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:35.682168 2298 init.cc:377] Logged in from keytab as oryx/127.23.131.125@KRBTEST.COM (short username oryx)
I20260809 22:50:35.688339 2298 webserver.cc:460] Webserver started at http://127.23.131.125:33581/ using document root <none> and password file <none>
I20260809 22:50:35.688766 2298 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:35.688858 2298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:35.692250 2298 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 22:50:35.694340 2483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:35.694882 2298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 22:50:35.695123 2298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
uuid: "36ebe0117f0d431e81a329b235a775c0"
format_stamp: "Formatted at 2026-08-09 22:50:35 on dist-test-slave-92m1"
server_key: "7dc7a25c781e784e58fc235a6eb4ab74"
server_key_iv: "6f9962cf63b6b26c8344bc4cc52e9e04"
server_key_version: "encryptionkey@0"
I20260809 22:50:35.695518 2298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:35.719359 2298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:35.724366 2298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:35.762844 2298 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.125:45835
I20260809 22:50:35.762876 2553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.125:45835 every 8 connection(s)
I20260809 22:50:35.764153 2298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
I20260809 22:50:35.770119 2561 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:50:35.774817 2561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Bootstrap starting.
I20260809 22:50:35.793272 2561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:50:35.793987 2561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Bootstrap complete.
I20260809 22:50:35.795310 2561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } }
I20260809 22:50:35.795603 2561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 36ebe0117f0d431e81a329b235a775c0, State: Initialized, Role: LEARNER
I20260809 22:50:35.795912 2561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } }
I20260809 22:50:35.797235 2561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:35.796963 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } }
I20260809 22:50:35.797711 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: LEARNER
I20260809 22:50:35.807813 2586 catalog_manager.cc:1259] Loaded cluster ID: 9c762ffd42c041bbbd17237e77cd20a7
I20260809 22:50:35.808557 2586 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: loading cluster ID for follower catalog manager: success
I20260809 22:50:35.812644 2586 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: acquiring CA information for follower catalog manager: success
I20260809 22:50:35.814733 2286 heartbeater.cc:503] Master 127.23.131.126:39199 was elected leader, sending a full tablet report...
I20260809 22:50:35.815426 2586 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 22:50:35.974906 2451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:35.975327 2451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:35.975461 2451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:35.987098 2451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:35.987267 2451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:35.987346 2451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:35.987423 2451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:35.987490 2451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:36.001220 2451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.124.keytab
--principal=oryx/127.23.131.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:37863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.131.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:36.002664 2451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:36.004189 2451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:36.016664 2593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:36.016800 2594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:36.016819 2600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:36.017735 2451 server_base.cc:1034] running on GCE node
I20260809 22:50:36.018572 2451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:36.020233 2451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:36.021529 2451 hybrid_clock.cc:648] HybridClock initialized: now 1786315836021467 us; error 48 us; skew 500 ppm
I20260809 22:50:36.021898 2451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:36.025293 2451 init.cc:377] Logged in from keytab as oryx/127.23.131.124@KRBTEST.COM (short username oryx)
I20260809 22:50:36.026962 2451 webserver.cc:460] Webserver started at http://127.23.131.124:35541/ using document root <none> and password file <none>
I20260809 22:50:36.027837 2451 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:36.027990 2451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:36.028301 2451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:36.031510 2451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/instance:
uuid: "821399bff72e43359c887b2bb5b8f167"
format_stamp: "Formatted at 2026-08-09 22:50:36 on dist-test-slave-92m1"
server_key: "0cd3cf604ef794919c030416ba3d40c8"
server_key_iv: "bfe6318942d72267a13899e2154e108e"
server_key_version: "encryptionkey@0"
I20260809 22:50:36.032330 2451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal/instance:
uuid: "821399bff72e43359c887b2bb5b8f167"
format_stamp: "Formatted at 2026-08-09 22:50:36 on dist-test-slave-92m1"
server_key: "0cd3cf604ef794919c030416ba3d40c8"
server_key_iv: "bfe6318942d72267a13899e2154e108e"
server_key_version: "encryptionkey@0"
I20260809 22:50:36.038326 2451 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:36.042059 2612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:36.043593 2451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:50:36.043795 2451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
uuid: "821399bff72e43359c887b2bb5b8f167"
format_stamp: "Formatted at 2026-08-09 22:50:36 on dist-test-slave-92m1"
server_key: "0cd3cf604ef794919c030416ba3d40c8"
server_key_iv: "bfe6318942d72267a13899e2154e108e"
server_key_version: "encryptionkey@0"
I20260809 22:50:36.044023 2451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:36.057401 2451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:36.062027 2451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:36.062342 2451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:36.083312 2451 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.124:37863
I20260809 22:50:36.083343 2698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.124:37863 every 8 connection(s)
I20260809 22:50:36.084489 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.076265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53764)
0809 22:50:36.076820 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.076848 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.077029 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.077980 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.077984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.078007 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:36.078211 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.078226 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.080470 (+ 2244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.080478 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.082005 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.082024 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.083874 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.083880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.084026 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.084073 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.084153 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.084260 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":266,"threads_started":1}
I20260809 22:50:36.084723 2676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.076432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.23.131.125:45835)
0809 22:50:36.077548 (+ 1116us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.077554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.077575 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:50:36.077658 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.077664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.077792 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.077944 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:36.078389 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.080300 (+ 1911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.082208 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.083681 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.083863 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.084079 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.084202 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.084348 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":943,"thread_start_us":779,"threads_started":1}
I20260809 22:50:36.085606 2451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
I20260809 22:50:36.086066 2517 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260809 22:50:36.086818 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f98f8157bcb4ce7800125df30f229f8. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } }
I20260809 22:50:36.087164 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: LEARNER
I20260809 22:50:36.089511 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 2451
I20260809 22:50:36.090301 2700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:36.099407 2700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.124@KRBTEST.COM
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.124@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:36.115629 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.091638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.23.131.124:37863)
0809 22:50:36.092322 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.092333 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.092373 (+ 40us) server_negotiation.cc:407] Connection header received
0809 22:50:36.094027 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.094048 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.094454 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.094874 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.096594 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.098458 (+ 1864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.100016 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.100961 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.101169 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.106168 (+ 4999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.106179 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.106193 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.106272 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.110563 (+ 4291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.111449 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.111457 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.111465 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.111643 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.112100 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.112104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.112106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.112761 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.113121 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.113506 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.114023 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":293,"threads_started":1}
I20260809 22:50:36.119297 2705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.102243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35470)
0809 22:50:36.103185 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.103261 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.103434 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.103847 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.103852 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.104461 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.104737 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.104745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.105826 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.105833 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.107884 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.107905 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.108830 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.108837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.109037 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.109657 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.109686 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.112453 (+ 2767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.116477 (+ 4024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.116487 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.116492 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.116957 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.117410 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.117414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.117417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.117591 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.118151 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.118158 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.118365 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.118533 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.118938 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":539,"threads_started":1}
I20260809 22:50:36.119297 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.102338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35470 (local address 127.23.131.126:39199)
0809 22:50:36.102573 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.102580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.103370 (+ 790us) server_negotiation.cc:407] Connection header received
0809 22:50:36.103571 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.103579 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.103676 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.103794 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.104895 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.105682 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.108044 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.108635 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.108787 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.112698 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.112705 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.112710 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.112753 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.116336 (+ 3583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.117126 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.117133 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.117143 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.117287 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.117710 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.117714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.117716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.117998 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.118113 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.118712 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.118969 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:50:36.120602 2700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.124@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
I20260809 22:50:36.133343 2705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.121228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53774)
0809 22:50:36.121424 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.121443 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.121541 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.121998 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.122001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.122338 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.122485 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.122493 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.123545 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.123548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.124451 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.124461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.125124 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.125128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.125283 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.125864 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.125880 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.128146 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.131041 (+ 2895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.131045 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.131047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.131652 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.132003 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.132006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.132009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.132143 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.132628 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.132632 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.132752 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.132861 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.133099 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 22:50:36.133569 2676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.121456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53774 (local address 127.23.131.125:45835)
0809 22:50:36.121670 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.121674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.121723 (+ 49us) server_negotiation.cc:407] Connection header received
0809 22:50:36.121789 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.121792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.121854 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.121933 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.122616 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.123420 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.124581 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.124995 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.125091 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.128322 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.128327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.128330 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.128363 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.130913 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.131757 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.131761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.131763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.131897 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.132237 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.132240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.132242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.132519 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.132648 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.132957 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.133239 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 22:50:36.134610 2700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.124@KRBTEST.COM for oryx/127.23.131.124@KRBTEST.COM
I20260809 22:50:36.147315 2705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.135413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.0.0.1:52336)
0809 22:50:36.135562 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.135583 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.135688 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.135990 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.135994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.136386 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.136646 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.136658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.137629 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.137636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.138534 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.138545 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.139257 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.139263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.139464 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.139970 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.139986 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.142023 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.144756 (+ 2733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.144763 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.144767 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.145128 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.145488 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.145493 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.145497 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.145651 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.146162 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.146167 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.146337 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.146470 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.146759 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 22:50:36.147388 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.135363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52336 (local address 127.23.131.124:37863)
0809 22:50:36.135563 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.135570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.135630 (+ 60us) server_negotiation.cc:407] Connection header received
0809 22:50:36.135809 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.135813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.135879 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.135973 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.136789 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.137498 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.138668 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.139072 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.139195 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.142196 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.142201 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.142205 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.142232 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.144630 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.145240 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.145247 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.145251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.145370 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.145754 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.145761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.145764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.146037 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.146217 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.146570 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.146995 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":54}
I20260809 22:50:36.153149 2700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Bootstrap starting.
I20260809 22:50:36.156312 2700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:36.157316 2700 log.cc:824] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:36.160053 2700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: No bootstrap required, opened a new log
I20260809 22:50:36.167523 2700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } }
I20260809 22:50:36.167863 2700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:36.167958 2700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 821399bff72e43359c887b2bb5b8f167, State: Initialized, Role: FOLLOWER
I20260809 22:50:36.168555 2700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } }
I20260809 22:50:36.169562 2707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } } }
I20260809 22:50:36.170090 2707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:50:36.170832 2700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 22:50:36.180456 2728 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:50:36.180630 2728 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:50:36.184901 2451 master_runner.cc:428] Detected that this master 821399bff72e43359c887b2bb5b8f167 is joining an existing cluster
I20260809 22:50:36.185022 2451 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.131.124:37863
I20260809 22:50:36.210816 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.189189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35486 (local address 127.23.131.126:39199)
0809 22:50:36.189408 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.189414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.190893 (+ 1479us) server_negotiation.cc:407] Connection header received
0809 22:50:36.191271 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.191280 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.191389 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.191477 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.193447 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.194964 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.197932 (+ 2968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.198853 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.198977 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.203430 (+ 4453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.203439 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.203446 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.203493 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.207322 (+ 3829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.208151 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.208157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.208162 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.208317 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.208853 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.208859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.208865 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.209266 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.209402 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.210194 (+ 792us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.210445 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 22:50:36.212495 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.189831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35486)
0809 22:50:36.190758 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.190786 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.191043 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.191751 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.191759 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.192720 (+ 961us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.193217 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.193235 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.195233 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.195241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.197704 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.197728 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.199408 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.199417 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.200058 (+ 641us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.201101 (+ 1043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.201135 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.203165 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.207492 (+ 4327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.207497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.207501 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.207973 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.208465 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.208469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.208472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.208709 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.209512 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.209518 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.209790 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.211458 (+ 1668us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.211842 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":563,"threads_started":1}
I20260809 22:50:36.216120 2676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.189338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53790 (local address 127.23.131.125:45835)
0809 22:50:36.189574 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.189580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.198063 (+ 8483us) server_negotiation.cc:407] Connection header received
0809 22:50:36.198702 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.198711 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.198801 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.198873 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.200931 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.202040 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.204322 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.205014 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.205114 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.207759 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.207768 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.207772 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.207815 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.212660 (+ 4845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.213575 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.213580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.213584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.213744 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.214266 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.214271 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.214275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.214664 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.214804 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.215511 (+ 707us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.215766 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 22:50:36.217248 2743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.189937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53790)
0809 22:50:36.197939 (+ 8002us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.197960 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.198491 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.199092 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.199097 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.200363 (+ 1266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.200740 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.200753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.202296 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.202302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.204112 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.204153 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.205478 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.205484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.205679 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.206341 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.206363 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.207528 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.212823 (+ 5295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.212827 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.212836 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.213417 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.213902 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.213907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.213911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.214121 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.214899 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.214905 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.215126 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.216388 (+ 1262us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.216765 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7810,"thread_start_us":12791,"threads_started":1}
I20260809 22:50:36.222317 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 1626
I20260809 22:50:36.223469 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.189211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.23.131.124:37863)
0809 22:50:36.189776 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.189782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.202554 (+ 12772us) server_negotiation.cc:407] Connection header received
0809 22:50:36.202745 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.202750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.202819 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.202913 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.204340 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.205468 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.207684 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.208415 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.208533 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.211382 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.211388 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.211392 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.211434 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.215386 (+ 3952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.216154 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.216161 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.216165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.217033 (+ 868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.221351 (+ 4318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.221360 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.221406 (+ 46us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.221855 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.222070 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.222799 (+ 729us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.223060 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:50:36.224535 2742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.190443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.0.0.1:52338)
0809 22:50:36.202442 (+ 11999us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.202463 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.202621 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.202995 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.202999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.203758 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.204185 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.204201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.205730 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.205735 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.207549 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.207566 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.208922 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.208928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.209085 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.209915 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.209941 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.211177 (+ 1236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.215556 (+ 4379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.215560 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.215563 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.216037 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.217178 (+ 1141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.217182 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.217189 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.221208 (+ 4019us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.222149 (+ 941us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.222154 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.222423 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.223706 (+ 1283us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.224028 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11838,"mutex_wait_us":4,"thread_start_us":7635,"threads_started":1}
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.126@KRBTEST.COM for oryx/127.23.131.124@KRBTEST.COM
I20260809 22:50:36.237893 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.219195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.0.0.1:52340)
0809 22:50:36.219512 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.219531 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.219634 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.221043 (+ 1409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.221049 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.221582 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.221813 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.221827 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.224118 (+ 2291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.224125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.225619 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.225637 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.226951 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.226957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.227153 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.228146 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.228173 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.230410 (+ 2237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.234445 (+ 4035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.234451 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.234455 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.235080 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.235687 (+ 607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.235693 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.235697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.235889 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.236644 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.236650 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.236838 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.237108 (+ 270us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.237440 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260809 22:50:36.237993 2744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.219822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52340 (local address 127.23.131.124:37863)
0809 22:50:36.220603 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.220609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.220631 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:50:36.220725 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.220731 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.220813 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.221971 (+ 1158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.222550 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.223941 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.225905 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.226718 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.227750 (+ 1032us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.230659 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.230664 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.230668 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.230712 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.234280 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.235271 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.235277 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.235280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.235495 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.236050 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.236055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.236058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.236481 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.236648 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.237220 (+ 572us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.237493 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":642,"thread_start_us":443,"threads_started":1}
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.65@KRBTEST.COM
I20260809 22:50:36.240684 1525 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.131.124:37863: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "821399bff72e43359c887b2bb5b8f167"
member_type: NON_VOTER
last_known_addr {
host: "127.23.131.124"
port: 37863
}
attrs {
promote: true
}
}
dest_uuid: "5f98f8157bcb4ce7800125df30f229f8"
cas_config_opid_index: 5
I20260809 22:50:36.241786 1525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } }
I20260809 22:50:36.243999 2661 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 821399bff72e43359c887b2bb5b8f167 (127.23.131.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.248224 2517 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 LEARNER]: Refusing update from remote peer 5f98f8157bcb4ce7800125df30f229f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 22:50:36.250313 2656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:36.250427 2745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.223720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.23.131.65:33823)
0809 22:50:36.227440 (+ 3720us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.227447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.227472 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:50:36.227587 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.227598 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.227908 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.228100 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.229917 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.231590 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.233535 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.234511 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.234652 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.241389 (+ 6737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.241412 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.241433 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.241493 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.245773 (+ 4280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.246801 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.246813 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.246817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.246995 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.247559 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.247565 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.247568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.248109 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.248414 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.249667 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.249977 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3563,"thread_start_us":3273,"threads_started":1}
I20260809 22:50:36.252955 1844 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:36.255023 2661 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.131.124:37863
I20260809 22:50:36.265360 2747 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 22:50:36.270757 2517 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 821399bff72e43359c887b2bb5b8f167 (127.23.131.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.275137 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.275501 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: LEARNER
I20260809 22:50:36.276000 2752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: NON_VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: true } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.276365 2752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:36.277134 2661 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: attempting to promote NON_VOTER 36ebe0117f0d431e81a329b235a775c0 to VOTER
I20260809 22:50:36.277858 2661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } }
I20260809 22:50:36.279573 2451 master.cc:537] Master@127.23.131.124:37863 shutting down...
I20260809 22:50:36.279866 2656 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Refusing update from remote peer 5f98f8157bcb4ce7800125df30f229f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 22:50:36.295641 2517 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 LEARNER]: Refusing update from remote peer 5f98f8157bcb4ce7800125df30f229f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 22:50:36.298328 2451 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:36.298774 2451 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:36.297714 2749 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260809 22:50:36.299001 2451 tablet_replica.cc:330] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: stopping tablet replica
I20260809 22:50:36.302677 2747 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 36ebe0117f0d431e81a329b235a775c0 (127.23.131.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.307353 2517 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 36ebe0117f0d431e81a329b235a775c0 (127.23.131.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.309257 2451 master.cc:552] Master@127.23.131.124:37863 shutdown complete.
I20260809 22:50:36.309355 2451 master_runner.cc:305] Clearing existing system tablet
I20260809 22:50:36.309772 2451 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:36.309886 2451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260809 22:50:36.314883 1497 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 -> Peer 821399bff72e43359c887b2bb5b8f167 (127.23.131.124:37863): Couldn't send request to peer 821399bff72e43359c887b2bb5b8f167. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260809 22:50:36.315887 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.316185 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:50:36.317685 2747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.318020 2747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:36.318298 2749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.318560 2749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:36.320005 2451 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.006s sys 0.005s
I20260809 22:50:36.321935 2759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:36.322386 2451 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:36.322860 2451 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 22:50:36.323050 2451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
uuid: "821399bff72e43359c887b2bb5b8f167"
format_stamp: "Formatted at 2026-08-09 22:50:36 on dist-test-slave-92m1"
server_key: "0cd3cf604ef794919c030416ba3d40c8"
server_key_iv: "bfe6318942d72267a13899e2154e108e"
server_key_version: "encryptionkey@0"
I20260809 22:50:36.328701 2451 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:36.336413 2451 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 22:50:36.336745 2451 log.cc:1196] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 22:50:36.337407 2451 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Deleting consensus metadata
I20260809 22:50:36.337759 2451 master_runner.cc:315] Copying system tablet from 127.23.131.126:39199
I20260809 22:50:36.340850 2451 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: tablet copy: Beginning tablet copy session from remote peer at address 127.23.131.126:39199
I20260809 22:50:36.358902 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.341898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35500 (local address 127.23.131.126:39199)
0809 22:50:36.342167 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.342174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.342689 (+ 515us) server_negotiation.cc:407] Connection header received
0809 22:50:36.343002 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.343010 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.343102 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.343176 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.344543 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.345701 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.347727 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.348570 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.348691 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.351576 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.351585 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.351593 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.351638 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:36.355409 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.356337 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.356344 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.356348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.356520 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:36.357104 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:36.357110 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:36.357113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:36.357504 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:36.357658 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.358254 (+ 596us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.358515 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260809 22:50:36.360252 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.341837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35500)
0809 22:50:36.342553 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.342589 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.342822 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.343438 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.343443 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.344069 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.344350 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.344363 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.345931 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.345937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.347538 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.347555 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.349024 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.349031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.349234 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.350071 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.350099 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.351304 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:36.355584 (+ 4280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.355589 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.355593 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.356187 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.356685 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:36.356690 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:36.356693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:36.356960 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:36.357750 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:36.357756 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:36.357957 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.359328 (+ 1371us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.359732 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":440,"threads_started":1}
I20260809 22:50:36.360997 1561 tablet_copy_service.cc:140] P 5f98f8157bcb4ce7800125df30f229f8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 821399bff72e43359c887b2bb5b8f167 ({username='oryx', principal='oryx/127.23.131.124@KRBTEST.COM'} at 127.0.0.1:35500)
I20260809 22:50:36.361189 1561 tablet_copy_service.cc:161] P 5f98f8157bcb4ce7800125df30f229f8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 821399bff72e43359c887b2bb5b8f167 at {username='oryx', principal='oryx/127.23.131.124@KRBTEST.COM'} at 127.0.0.1:35500: session id = 821399bff72e43359c887b2bb5b8f167-00000000000000000000000000000000
I20260809 22:50:36.365339 1561 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 22:50:36.367580 2451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 22:50:36.375334 2451 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: tablet copy: Starting download of 0 data blocks...
I20260809 22:50:36.375697 2451 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: tablet copy: Starting download of 1 WAL segments...
I20260809 22:50:36.378496 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 1626
I20260809 22:50:36.379878 2451 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 22:50:36.384497 1561 tablet_copy_service.cc:342] P 5f98f8157bcb4ce7800125df30f229f8: Request end of tablet copy session 821399bff72e43359c887b2bb5b8f167-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.131.124@KRBTEST.COM'} at 127.0.0.1:35500
I20260809 22:50:36.384646 1561 tablet_copy_service.cc:433] P 5f98f8157bcb4ce7800125df30f229f8: ending tablet copy session 821399bff72e43359c887b2bb5b8f167-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 821399bff72e43359c887b2bb5b8f167
I20260809 22:50:36.399549 2451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:36.408907 2771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:36.410336 2774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:36.418176 2451 server_base.cc:1034] running on GCE node
W20260809 22:50:36.418401 2776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:36.418421 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:33823
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:39199
--webserver_port=39169
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:50:36.418949 2451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:36.419682 2451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:36.423173 2451 hybrid_clock.cc:648] HybridClock initialized: now 1786315836423101 us; error 38 us; skew 500 ppm
I20260809 22:50:36.423511 2451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:36.426186 2451 init.cc:377] Logged in from keytab as oryx/127.23.131.124@KRBTEST.COM (short username oryx)
I20260809 22:50:36.431571 2451 webserver.cc:460] Webserver started at http://127.23.131.124:36221/ using document root <none> and password file <none>
I20260809 22:50:36.432031 2451 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:36.432168 2451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:36.435827 2451 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 22:50:36.439633 2789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:36.440176 2451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 22:50:36.440362 2451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
uuid: "821399bff72e43359c887b2bb5b8f167"
format_stamp: "Formatted at 2026-08-09 22:50:36 on dist-test-slave-92m1"
server_key: "0cd3cf604ef794919c030416ba3d40c8"
server_key_iv: "bfe6318942d72267a13899e2154e108e"
server_key_version: "encryptionkey@0"
I20260809 22:50:36.440647 2451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:36.474200 2451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:36.479094 2451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:36.520722 2451 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.124:37863
I20260809 22:50:36.520795 2874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.124:37863 every 8 connection(s)
I20260809 22:50:36.522135 2451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
I20260809 22:50:36.528394 2875 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:50:36.532785 2875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Bootstrap starting.
I20260809 22:50:36.553100 2875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:50:36.553743 2875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: Bootstrap complete.
I20260809 22:50:36.555020 2875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } }
I20260809 22:50:36.555380 2875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 821399bff72e43359c887b2bb5b8f167, State: Initialized, Role: LEARNER
I20260809 22:50:36.555709 2875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } }
I20260809 22:50:36.556675 2879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.557165 2879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: This master's current role is: LEARNER
I20260809 22:50:36.556981 2875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:36.568862 2897 catalog_manager.cc:1259] Loaded cluster ID: 9c762ffd42c041bbbd17237e77cd20a7
I20260809 22:50:36.568991 2897 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: loading cluster ID for follower catalog manager: success
I20260809 22:50:36.572850 2897 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: acquiring CA information for follower catalog manager: success
I20260809 22:50:36.575449 2897 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 22:50:36.826445 2784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:36.826834 2784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:36.827044 2784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:36.834486 2784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:36.834661 2784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:36.834848 2784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:36.845337 2784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:33823
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=39169
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:36.846778 2784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:36.848277 2784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:36.862282 2902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:36.862314 2905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:36.862365 2903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:36.863085 2784 server_base.cc:1034] running on GCE node
I20260809 22:50:36.863744 2784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:36.864890 2784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:36.866118 2784 hybrid_clock.cc:648] HybridClock initialized: now 1786315836866088 us; error 61 us; skew 500 ppm
I20260809 22:50:36.866436 2784 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:36.869833 2784 init.cc:377] Logged in from keytab as oryx/127.23.131.65@KRBTEST.COM (short username oryx)
I20260809 22:50:36.871450 2784 webserver.cc:460] Webserver started at http://127.23.131.65:39169/ using document root <none> and password file <none>
I20260809 22:50:36.872136 2784 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:36.872254 2784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:36.877980 2784 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 22:50:36.880839 2914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:36.882359 2784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:50:36.882612 2784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "06f078d4f0c8485aa34bb06ad7063052"
format_stamp: "Formatted at 2026-08-09 22:50:33 on dist-test-slave-92m1"
server_key: "48b91c67d1202e5aafd2f420f0105fde"
server_key_iv: "c7b36f188c11f3b93a430f7299ee3b66"
server_key_version: "encryptionkey@0"
I20260809 22:50:36.883873 2784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:36.909688 2784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:36.910586 2925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.903997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52354 (local address 127.23.131.124:37863)
0809 22:50:36.904571 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.904577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.904594 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:50:36.904660 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.904664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.904738 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.904845 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:36.905365 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.906355 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.908686 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.909479 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.909607 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.909735 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:36.910169 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 22:50:36.910276 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":321,"threads_started":1}
I20260809 22:50:36.910724 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.903722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.0.0.1:52354)
0809 22:50:36.904271 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.904294 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.904463 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.904917 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.904922 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.904953 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:36.905175 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.905188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.906539 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.906545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.908496 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.908514 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.909703 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.909711 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.909954 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.909996 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 22:50:36.910134 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 22:50:36.910286 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":259,"threads_started":1}
I20260809 22:50:36.911731 2825 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 22:50:36.912308 2879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f98f8157bcb4ce7800125df30f229f8. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:36.912712 2879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: This master's current role is: LEARNER
I20260809 22:50:36.915115 2784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:36.915426 2784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:36.916484 2784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:36.918063 2784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:36.918184 2784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:36.918287 2784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:36.918354 2784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:36.958335 2784 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:33823
I20260809 22:50:36.958441 3103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:33823 every 8 connection(s)
I20260809 22:50:36.960119 2784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:36.968640 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 2784
I20260809 22:50:36.969074 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 1859
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.124@KRBTEST.COM
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
Aug 09 22:50:36 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315836, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
I20260809 22:50:37.008805 2925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.965543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:51755 (local address 127.23.131.124:37863)
0809 22:50:36.965824 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.965834 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.982639 (+ 16805us) server_negotiation.cc:407] Connection header received
0809 22:50:36.982873 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.982881 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.982989 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.983104 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.987477 (+ 4373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.988661 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.991537 (+ 2876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.992227 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.992332 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.999183 (+ 6851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:36.999190 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:36.999195 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:36.999268 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.002978 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.005032 (+ 2054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.005039 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.005044 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.005222 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.006160 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.006168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.006171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.006600 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.006762 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.008022 (+ 1260us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.008306 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
Aug 09 22:50:37 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.66@KRBTEST.COM
I20260809 22:50:37.010164 3114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.963287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:41195 (local address 127.23.131.125:45835)
0809 22:50:36.969995 (+ 6708us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.970004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.983524 (+ 13520us) server_negotiation.cc:407] Connection header received
0809 22:50:36.983701 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.983708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.983824 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.983944 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.986998 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.988191 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.992953 (+ 4762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.993601 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.993692 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.003037 (+ 9345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.003045 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.003050 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.003094 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.006939 (+ 3845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.007776 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.007782 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.007788 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.007958 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.008394 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.008398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.008401 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.008806 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.008980 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.009540 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.009776 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6555,"thread_start_us":6434,"threads_started":1}
I20260809 22:50:37.010164 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.963504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:48141 (local address 127.23.131.126:39199)
0809 22:50:36.984108 (+ 20604us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.984117 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.984139 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:50:36.984207 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.984212 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.984292 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.984425 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.987418 (+ 2993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.988859 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.991303 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.992028 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.992165 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.001411 (+ 9246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.001428 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.001434 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.001476 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.005806 (+ 4330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.006629 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.006635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.006640 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.006793 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.007286 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.007291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.007294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.007661 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.007830 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.009335 (+ 1505us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.009625 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20433,"thread_start_us":20269,"threads_started":1}
I20260809 22:50:37.011240 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.964312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.23.131.65:51755)
0809 22:50:36.982427 (+ 18115us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.982445 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.982710 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.984274 (+ 1564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.984287 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.985640 (+ 1353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.986791 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.986818 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.988885 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.988891 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.991345 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.991372 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.992842 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.992853 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.993325 (+ 472us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.994430 (+ 1105us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.994487 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:36.998883 (+ 4396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:37.003171 (+ 4288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.003183 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.003225 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.003982 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.005668 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.005675 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.005679 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.005982 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.006898 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:37.006910 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:37.007463 (+ 553us) client_negotiation.cc:769] Sending connection context
0809 22:50:37.009170 (+ 1707us) client_negotiation.cc:240] Negotiation successful
0809 22:50:37.009517 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17989,"mutex_wait_us":37,"spinlock_wait_cycles":44288,"thread_start_us":18645,"threads_started":1}
I20260809 22:50:37.011804 3117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.964101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:48141)
0809 22:50:36.975075 (+ 10974us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.975162 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.980794 (+ 5632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.984500 (+ 3706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.984505 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.985587 (+ 1082us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.987238 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.987257 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.988976 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.988981 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.991139 (+ 2158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.991158 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.992828 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.992838 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.994351 (+ 1513us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.994988 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.995011 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:37.000923 (+ 5912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:37.005973 (+ 5050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.005979 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.005982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.006475 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.006935 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.006939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.006943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.007121 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.007894 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:37.007899 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:37.008076 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 22:50:37.008251 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 22:50:37.008892 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10457,"mutex_wait_us":1858,"spinlock_wait_cycles":2432,"thread_start_us":10963,"threads_started":1}
I20260809 22:50:37.011996 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.964101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.23.131.65:41195)
0809 22:50:36.983364 (+ 19263us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:36.983384 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:36.983575 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:36.984837 (+ 1262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:36.984842 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:36.986218 (+ 1376us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:36.986785 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.986810 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.988531 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.988537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.992516 (+ 3979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:36.992530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:36.996239 (+ 3709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:36.996245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:36.996804 (+ 559us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:36.997551 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:36.997573 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:37.002737 (+ 5164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:37.007089 (+ 4352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.007094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.007097 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.007626 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.008103 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.008108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.008112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.008274 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.009076 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:37.009081 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:37.009225 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 22:50:37.010444 (+ 1219us) client_negotiation.cc:240] Negotiation successful
0809 22:50:37.010737 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18570,"spinlock_wait_cycles":4864,"thread_start_us":17536,"threads_started":1}
I20260809 22:50:37.013473 3107 heartbeater.cc:347] Connected to a master server at 127.23.131.124:37863
I20260809 22:50:37.013501 3111 heartbeater.cc:347] Connected to a master server at 127.23.131.125:45835
I20260809 22:50:37.013713 3108 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39199
I20260809 22:50:37.013845 3107 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:37.013849 3111 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:37.013942 3108 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:37.014899 3111 heartbeater.cc:511] Master 127.23.131.125:45835 requested a full tablet report, sending...
I20260809 22:50:37.014930 3108 heartbeater.cc:511] Master 127.23.131.126:39199 requested a full tablet report, sending...
I20260809 22:50:37.015499 3107 heartbeater.cc:511] Master 127.23.131.124:37863 requested a full tablet report, sending...
I20260809 22:50:37.017124 1524 ts_manager.cc:194] Re-registered known tserver with Master: 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823)
I20260809 22:50:37.017552 2505 ts_manager.cc:194] Registered new tserver with Master: 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823)
I20260809 22:50:37.018478 1524 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:48141
I20260809 22:50:37.020238 2815 ts_manager.cc:194] Registered new tserver with Master: 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823)
I20260809 22:50:37.020426 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:36.970364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.23.131.66:38853)
0809 22:50:36.995675 (+ 25311us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:36.995686 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:36.995723 (+ 37us) server_negotiation.cc:407] Connection header received
0809 22:50:36.996090 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:36.996103 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:36.996503 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:36.999371 (+ 2868us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:36.999766 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.001692 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.003854 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.004644 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.004822 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.011307 (+ 6485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.011326 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.011344 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.011400 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.015759 (+ 4359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.016791 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.016799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.016802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.016978 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.017546 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.017551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.017554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.018015 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.019412 (+ 1397us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.019614 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.019905 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25090,"thread_start_us":25476,"threads_started":1}
I20260809 22:50:37.022152 2051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:37.109858 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 1859
I20260809 22:50:37.135190 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:38853
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:39199
--webserver_port=34239
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:50:37.473727 2747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: NON_VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: true } } }
I20260809 22:50:37.474151 2747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:37.475767 2747 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: attempting to promote NON_VOTER 821399bff72e43359c887b2bb5b8f167 to VOTER
I20260809 22:50:37.476519 2747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } }
I20260809 22:50:37.478909 2517 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Refusing update from remote peer 5f98f8157bcb4ce7800125df30f229f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 22:50:37.479054 2825 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 LEARNER]: Refusing update from remote peer 5f98f8157bcb4ce7800125df30f229f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 22:50:37.480301 2747 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 22:50:37.480752 3131 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 22:50:37.484262 3131 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 821399bff72e43359c887b2bb5b8f167 (127.23.131.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.485035 2517 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 821399bff72e43359c887b2bb5b8f167 (127.23.131.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.485983 2825 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 821399bff72e43359c887b2bb5b8f167 (127.23.131.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.489768 3132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.490298 3132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:37.490824 3132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.491214 3132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:37.491586 3132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.491973 3132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:37.495780 3140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.496372 3140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:50:37.497305 3141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f98f8157bcb4ce7800125df30f229f8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:37.497691 3141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 22:50:37.504983 3130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:37.505283 3130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:37.505383 3130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:37.513438 3130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:37.513571 3130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:37.513692 3130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:37.524302 3130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:38853
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=34239
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:37.525763 3130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:37.527371 3130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:37.541471 3160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:37.542148 3163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:37.543277 3130 server_base.cc:1034] running on GCE node
W20260809 22:50:37.544968 3156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:37.546020 3130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:37.547633 3130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:37.548926 3130 hybrid_clock.cc:648] HybridClock initialized: now 1786315837548844 us; error 63 us; skew 500 ppm
I20260809 22:50:37.549355 3130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:37 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315837, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:37.553117 3130 init.cc:377] Logged in from keytab as oryx/127.23.131.66@KRBTEST.COM (short username oryx)
I20260809 22:50:37.554929 3130 webserver.cc:460] Webserver started at http://127.23.131.66:34239/ using document root <none> and password file <none>
I20260809 22:50:37.555780 3130 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:37.555985 3130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:37.562491 3130 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 22:50:37.565373 3172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:37.566849 3130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:50:37.567087 3130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "d57511cff5c042b88bcf92f43e96dbe8"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "9e7101c261a3dd6bfcfc67f230cd33f6"
server_key_iv: "54d0419b2a58ca739a251addc7f2bdae"
server_key_version: "encryptionkey@0"
I20260809 22:50:37.568249 3130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:37.584472 3130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:37.589514 3130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:37.589900 3130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:37.591027 3130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:37.592568 3130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:37.592724 3130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:37.592882 3130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:37.592993 3130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:37.631989 3130 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:38853
I20260809 22:50:37.632087 3350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:38853 every 8 connection(s)
I20260809 22:50:37.633671 3130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:37.636574 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 3130
I20260809 22:50:37.636893 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 2071
Aug 09 22:50:37 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315837, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
Aug 09 22:50:37 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315837, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.124@KRBTEST.COM
Aug 09 22:50:37 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315837, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
Aug 09 22:50:37 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.67@KRBTEST.COM
I20260809 22:50:37.682698 3362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.637447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:35197 (local address 127.23.131.125:45835)
0809 22:50:37.664127 (+ 26680us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:37.664135 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:37.664154 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:50:37.664215 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:37.664220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:37.664323 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:37.665424 (+ 1101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:37.665602 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.666753 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.669291 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.669954 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.670815 (+ 861us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.674212 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.674218 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.674221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.674267 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.678151 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.679504 (+ 1353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.679512 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.679516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.679702 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.680345 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.680348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.680351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.680842 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.681039 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.682035 (+ 996us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.682305 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25726,"thread_start_us":26446,"threads_started":1}
I20260809 22:50:37.683926 3369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.637397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.23.131.66:35197)
0809 22:50:37.647288 (+ 9891us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:37.647361 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:37.651171 (+ 3810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:37.664510 (+ 13339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:37.664515 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:37.664982 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:37.665262 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:37.665273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.666956 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.666961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:37.669069 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:37.669087 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.670209 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.670217 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:37.670464 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.671122 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:37.671144 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:37.673914 (+ 2770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:37.678361 (+ 4447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.678372 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.678404 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.679304 (+ 900us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.679860 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.679869 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.679877 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.680209 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.681024 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:37.681035 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:37.681571 (+ 536us) client_negotiation.cc:769] Sending connection context
0809 22:50:37.681923 (+ 352us) client_negotiation.cc:240] Negotiation successful
0809 22:50:37.682542 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9414,"mutex_wait_us":86,"thread_start_us":18087,"threads_started":1}
I20260809 22:50:37.684177 3360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.636835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:42415 (local address 127.23.131.126:39199)
0809 22:50:37.654140 (+ 17305us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:37.654150 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:37.656146 (+ 1996us) server_negotiation.cc:407] Connection header received
0809 22:50:37.657347 (+ 1201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:37.657357 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:37.657460 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:37.657583 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:37.661867 (+ 4284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.663186 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.666193 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.666690 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.666859 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.674216 (+ 7357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.674224 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.674230 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.674291 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.678439 (+ 4148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.679755 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.679766 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.679772 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.679983 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.681470 (+ 1487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.681475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.681479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.681843 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.682046 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.683436 (+ 1390us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.683699 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17106,"thread_start_us":17328,"threads_started":1}
I20260809 22:50:37.684878 3364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.638006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:42415)
0809 22:50:37.655993 (+ 17987us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:37.656025 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:37.656514 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:37.658781 (+ 2267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:37.658794 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:37.660460 (+ 1666us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:37.661641 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:37.661688 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.663385 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.663401 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:37.666041 (+ 2640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:37.666061 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.666993 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.667005 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:37.667485 (+ 480us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.668938 (+ 1453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:37.668980 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:37.673898 (+ 4918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:37.678706 (+ 4808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.678712 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.678718 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.679473 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.681129 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.681138 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.681143 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.681331 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.682868 (+ 1537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:37.682877 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:37.683054 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 22:50:37.683306 (+ 252us) client_negotiation.cc:240] Negotiation successful
0809 22:50:37.683650 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17788,"mutex_wait_us":1,"thread_start_us":8639,"threads_started":1}
I20260809 22:50:37.685837 3372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.648523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.23.131.66:58987)
0809 22:50:37.662082 (+ 13559us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:37.662110 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:37.662213 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:37.662832 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:37.662840 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:37.663485 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:37.663962 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:37.663981 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.665585 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.665590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:37.667443 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:37.667458 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.668642 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.668656 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:37.669048 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.669792 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:37.669827 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:37.673980 (+ 4153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:37.680499 (+ 6519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.680505 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.680508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.681082 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.682338 (+ 1256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:37.682344 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:37.682349 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:37.682571 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:37.684612 (+ 2041us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:37.684617 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:37.684797 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 22:50:37.684995 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 22:50:37.685321 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13403,"mutex_wait_us":154,"thread_start_us":13206,"threads_started":1}
I20260809 22:50:37.685994 3356 heartbeater.cc:347] Connected to a master server at 127.23.131.125:45835
I20260809 22:50:37.686293 3356 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:37.687131 3373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.649191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:58987 (local address 127.23.131.124:37863)
0809 22:50:37.662455 (+ 13264us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:37.662463 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:37.662486 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:50:37.662550 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:37.662556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:37.662678 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:37.662795 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:37.664173 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.665404 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.667646 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.668407 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.668555 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.675114 (+ 6559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.675123 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.675129 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.675180 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.680336 (+ 5156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.681260 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.681269 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.681273 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.682174 (+ 901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.682734 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.682739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.682742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.683178 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.684536 (+ 1358us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.686391 (+ 1855us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.686673 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13082,"thread_start_us":13083,"threads_started":1}
I20260809 22:50:37.687143 3356 heartbeater.cc:511] Master 127.23.131.125:45835 requested a full tablet report, sending...
I20260809 22:50:37.688153 3351 heartbeater.cc:347] Connected to a master server at 127.23.131.124:37863
I20260809 22:50:37.688278 3351 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:37.688462 3371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:37.638628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.23.131.67:46073)
0809 22:50:37.656342 (+ 17714us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:37.656357 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:37.657471 (+ 1114us) server_negotiation.cc:407] Connection header received
0809 22:50:37.657797 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:37.657808 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:37.658053 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:37.658244 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:37.660795 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.663727 (+ 2932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.665876 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:37.667952 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:37.668125 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:37.677419 (+ 9294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:37.677446 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:37.677468 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:37.677538 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:37.681700 (+ 4162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.684064 (+ 2364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.684075 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.684081 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.684406 (+ 325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:37.684985 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:37.684991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:37.684994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:37.685827 (+ 833us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:37.686280 (+ 453us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:37.686995 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 22:50:37.687763 (+ 768us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16532,"thread_start_us":16359,"threads_started":1}
I20260809 22:50:37.688752 3351 heartbeater.cc:511] Master 127.23.131.124:37863 requested a full tablet report, sending...
I20260809 22:50:37.689363 3352 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39199
I20260809 22:50:37.689507 3352 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:37.690006 3352 heartbeater.cc:511] Master 127.23.131.126:39199 requested a full tablet report, sending...
I20260809 22:50:37.690037 2815 ts_manager.cc:194] Registered new tserver with Master: d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:37.690109 2280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:37.691134 2505 ts_manager.cc:194] Registered new tserver with Master: d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:37.691350 1524 ts_manager.cc:194] Re-registered known tserver with Master: d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:37.692777 1524 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:42415
I20260809 22:50:37.776793 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 2071
I20260809 22:50:37.803989 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:46073
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:39199
--webserver_port=46427
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:50:38.021126 3108 heartbeater.cc:503] Master 127.23.131.126:39199 was elected leader, sending a full tablet report...
W20260809 22:50:38.172271 3377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:38.172578 3377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:38.172699 3377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:38.181020 3377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:38.181159 3377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:38.181278 3377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:38.192440 3377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:46073
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=46427
--tserver_master_addrs=127.23.131.126:39199,127.23.131.125:45835,127.23.131.124:37863
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:38.193852 3377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:38.195183 3377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:38.209882 3382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:38.209909 3390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:38.210019 3384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:38.210911 3377 server_base.cc:1034] running on GCE node
I20260809 22:50:38.211663 3377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:38.212672 3377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:38.213881 3377 hybrid_clock.cc:648] HybridClock initialized: now 1786315838213841 us; error 37 us; skew 500 ppm
I20260809 22:50:38.214236 3377 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:38 dist-test-slave-92m1 krb5kdc[1442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315838, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:38.217732 3377 init.cc:377] Logged in from keytab as oryx/127.23.131.67@KRBTEST.COM (short username oryx)
I20260809 22:50:38.219184 3377 webserver.cc:460] Webserver started at http://127.23.131.67:46427/ using document root <none> and password file <none>
I20260809 22:50:38.219944 3377 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:38.220075 3377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:38.225857 3377 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 22:50:38.228715 3398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:38.230060 3377 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:50:38.230211 3377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "0ef6a043d74449919221b6ae22950649"
format_stamp: "Formatted at 2026-08-09 22:50:34 on dist-test-slave-92m1"
server_key: "fec41aeda091127c244b72687fa4ebb9"
server_key_iv: "8e146808ac4c0ed6a075d30b9eef3706"
server_key_version: "encryptionkey@0"
I20260809 22:50:38.231184 3377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:38.256901 3377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:38.261600 3377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:38.261861 3377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:38.262862 3377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:38.264344 3377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:38.264437 3377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:38.264526 3377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:38.264585 3377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:38.301537 3377 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:46073
I20260809 22:50:38.301613 3592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:46073 every 8 connection(s)
I20260809 22:50:38.303071 3377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:38.307363 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 3377
Aug 09 22:50:38 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315838, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.125@KRBTEST.COM
Aug 09 22:50:38 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315838, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
Aug 09 22:50:38 dist-test-slave-92m1 krb5kdc[1442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315838, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.124@KRBTEST.COM
I20260809 22:50:38.348238 3603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.306797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:56305 (local address 127.23.131.125:45835)
0809 22:50:38.318897 (+ 12100us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.318907 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.322838 (+ 3931us) server_negotiation.cc:407] Connection header received
0809 22:50:38.323592 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.323599 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.323708 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.323824 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.327151 (+ 3327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.328735 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.332092 (+ 3357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.333057 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.333185 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.339292 (+ 6107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.339302 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.339310 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.339369 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.343591 (+ 4222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.344690 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.344700 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.344707 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.344913 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.345607 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.345615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.345619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.346001 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.346167 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.347373 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.347646 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11979,"thread_start_us":11870,"threads_started":1}
I20260809 22:50:38.348896 3601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.306204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:53127 (local address 127.23.131.126:39199)
0809 22:50:38.319670 (+ 13466us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.319684 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.324255 (+ 4571us) server_negotiation.cc:407] Connection header received
0809 22:50:38.324366 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.324374 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.324510 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.324667 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.327236 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.328669 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.332221 (+ 3552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.333111 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.333214 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.339664 (+ 6450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.339674 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.339681 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.339738 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.345106 (+ 5368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.346091 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.346100 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.346106 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.346291 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.346829 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.346836 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.346842 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.347286 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.347454 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.348092 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.348411 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13325,"thread_start_us":13216,"threads_started":1}
I20260809 22:50:38.351076 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.309775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.23.131.67:56305)
0809 22:50:38.322630 (+ 12855us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.322651 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.323091 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.324308 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.324320 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.325866 (+ 1546us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:38.326907 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.326940 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.328995 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.329004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.331906 (+ 2902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.331924 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.333651 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.333660 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.334109 (+ 449us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.335274 (+ 1165us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:38.335314 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:38.338888 (+ 3574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:38.343777 (+ 4889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:38.343787 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:38.343806 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:38.344510 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:38.345096 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:38.345103 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:38.345109 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:38.345442 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:38.346268 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:38.346276 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:38.346854 (+ 578us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.348774 (+ 1920us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.349326 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12711,"mutex_wait_us":350,"spinlock_wait_cycles":36096,"thread_start_us":12492,"threads_started":1}
I20260809 22:50:38.351106 3604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.310169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:53127)
0809 22:50:38.323943 (+ 13774us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.323962 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.324097 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.324683 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.324696 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.325726 (+ 1030us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:38.326989 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.327007 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.328982 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.328991 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.331994 (+ 3003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.332016 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.333637 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.333647 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.334123 (+ 476us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.335533 (+ 1410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:38.335569 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:38.339405 (+ 3836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:38.345330 (+ 5925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:38.345338 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:38.345345 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:38.345930 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:38.346474 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:38.346482 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:38.346488 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:38.346689 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:38.347554 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:38.347562 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:38.347748 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.349852 (+ 2104us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.350266 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13650,"mutex_wait_us":285,"spinlock_wait_cycles":4224,"thread_start_us":9616,"threads_started":1}
I20260809 22:50:38.353477 3596 heartbeater.cc:347] Connected to a master server at 127.23.131.125:45835
I20260809 22:50:38.353580 3595 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39199
I20260809 22:50:38.353873 3595 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:38.353878 3596 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:38.355002 3596 heartbeater.cc:511] Master 127.23.131.125:45835 requested a full tablet report, sending...
I20260809 22:50:38.355662 3595 heartbeater.cc:511] Master 127.23.131.126:39199 requested a full tablet report, sending...
I20260809 22:50:38.356892 1524 ts_manager.cc:194] Re-registered known tserver with Master: 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073)
I20260809 22:50:38.357764 1524 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:53127
I20260809 22:50:38.358587 2505 ts_manager.cc:194] Registered new tserver with Master: 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073)
I20260809 22:50:38.374878 3602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.306289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:48127 (local address 127.23.131.124:37863)
0809 22:50:38.318495 (+ 12206us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.318505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.320397 (+ 1892us) server_negotiation.cc:407] Connection header received
0809 22:50:38.324261 (+ 3864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.324267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.324364 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.324475 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.330683 (+ 6208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.331826 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.339635 (+ 7809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.340369 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.340485 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.365704 (+ 25219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.365711 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.365716 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.365760 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.371329 (+ 5569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.372314 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.372321 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.372325 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.372491 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.373176 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.373184 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.373190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.373564 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.373746 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.374264 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.374497 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12028,"thread_start_us":11912,"threads_started":1}
I20260809 22:50:38.374962 3609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.306812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.23.131.67:48127)
0809 22:50:38.320182 (+ 13370us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.320241 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.323091 (+ 2850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.325166 (+ 2075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.325170 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.325726 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:38.326911 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.326940 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.334762 (+ 7822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.334773 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.336363 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.336379 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.341005 (+ 4626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.341014 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.341429 (+ 415us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.342346 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:38.342374 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:38.347520 (+ 5146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:38.371519 (+ 23999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:38.371528 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:38.371533 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:38.372148 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:38.372796 (+ 648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:38.372802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:38.372807 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:38.373027 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:38.373820 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:38.373827 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:38.374002 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.374157 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.374511 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13055,"mutex_wait_us":76,"spinlock_wait_cycles":26368,"thread_start_us":16711,"threads_started":1}
I20260809 22:50:38.375976 3593 heartbeater.cc:347] Connected to a master server at 127.23.131.124:37863
I20260809 22:50:38.376142 3593 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:38.376655 3593 heartbeater.cc:511] Master 127.23.131.124:37863 requested a full tablet report, sending...
I20260809 22:50:38.377971 2815 ts_manager.cc:194] Registered new tserver with Master: 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073)
I20260809 22:50:38.379849 3603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.333582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53796 (local address 127.23.131.125:45835)
0809 22:50:38.348695 (+ 15113us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.348703 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.360031 (+ 11328us) server_negotiation.cc:407] Connection header received
0809 22:50:38.360338 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.360346 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.360471 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.360551 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.364005 (+ 3454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.365193 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.367337 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.368103 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.368199 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.372384 (+ 4185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.372403 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.372410 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.372458 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.376169 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.377543 (+ 1374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.377548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.377552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.377688 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.378082 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.378090 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.378093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.378536 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.378796 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.379118 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.379394 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15008,"thread_start_us":30159,"threads_started":1}
I20260809 22:50:38.382308 3601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.327420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35504 (local address 127.23.131.126:39199)
0809 22:50:38.349453 (+ 22033us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.349459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.349476 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:50:38.349524 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.349531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.349605 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.349715 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.365413 (+ 15698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.366554 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.368925 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.369536 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.369683 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.375343 (+ 5660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.375349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.375354 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.375394 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.378988 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.379877 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.379882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.379887 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.380081 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.380655 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.380660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.380663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.381025 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.381286 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.381701 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.381972 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21915,"thread_start_us":21056,"threads_started":1}
I20260809 22:50:38.384940 3623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.349948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52366 (local address 127.23.131.124:37863)
0809 22:50:38.363473 (+ 13525us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.363480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.363502 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:50:38.363576 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.363583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.363676 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.363783 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.366565 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.368043 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.370180 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.370951 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.371086 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.375169 (+ 4083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.375177 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.375182 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.375243 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.381848 (+ 6605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.382785 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.382791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.382795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.382941 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.383369 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.383375 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.383379 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.383752 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.383991 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.384347 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.384584 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13382,"thread_start_us":13912,"threads_started":1}
I20260809 22:50:38.387414 1524 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:38.394922 1524 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:38.426470 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.418238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38853 (local address 127.0.0.1:49054)
0809 22:50:38.418952 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.419003 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.419130 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.419995 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.419999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.420034 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:38.420406 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.420416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.421832 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.421840 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.423642 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.423661 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.425670 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.425678 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.425888 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.425924 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.426026 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.426137 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":411,"threads_started":1}
I20260809 22:50:38.427641 3646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.418770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49054 (local address 127.23.131.66:38853)
0809 22:50:38.419404 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.419413 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.419446 (+ 33us) server_negotiation.cc:407] Connection header received
0809 22:50:38.419566 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.419574 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.419806 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.420015 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:38.420585 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.421694 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.423832 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.425422 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.426925 (+ 1503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.427188 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.427295 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.427445 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":844,"threads_started":1}
I20260809 22:50:38.431922 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5ba13508ec4513a54e2e3fc4234cd0 (DEFAULT_TABLE table=test-table [id=c6e0298de5634d5dbd3ef3202cdb9104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:38.433487 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.418243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46073 (local address 127.0.0.1:34730)
0809 22:50:38.419708 (+ 1465us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.419724 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.419830 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.424975 (+ 5145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.424983 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.425026 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:38.425611 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.425626 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.428690 (+ 3064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.428713 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.430840 (+ 2127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.430856 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.432508 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.432515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.432721 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.432762 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.432873 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.433022 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1361,"mutex_wait_us":140,"thread_start_us":986,"threads_started":1}
I20260809 22:50:38.434087 3256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5ba13508ec4513a54e2e3fc4234cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:38.434314 3649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.419299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34730 (local address 127.23.131.67:46073)
0809 22:50:38.423831 (+ 4532us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.423844 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.423887 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:50:38.424025 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.424037 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.424373 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.426177 (+ 1804us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:38.426620 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.428522 (+ 1902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.431021 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.432279 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.432437 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.432682 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.432918 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.433084 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4308,"thread_start_us":4099,"threads_started":1}
I20260809 22:50:38.436650 3636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.417284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33823 (local address 127.0.0.1:53204)
0809 22:50:38.418230 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.418251 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.418389 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.429631 (+ 11242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.429636 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.429672 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:38.430108 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.430117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.431685 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.431691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.433722 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.433738 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.435760 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.435767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.435947 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.435989 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.436091 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.436244 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":545,"threads_started":1}
I20260809 22:50:38.436918 3638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.417641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53204 (local address 127.23.131.65:33823)
0809 22:50:38.429126 (+ 11485us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.429133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.429156 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:50:38.429234 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.429239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.429428 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.429650 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:38.430302 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.431528 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.433911 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.435484 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.435674 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.435900 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.436162 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.436335 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11300,"thread_start_us":11179,"threads_started":1}
I20260809 22:50:38.438295 3487 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5ba13508ec4513a54e2e3fc4234cd0 (DEFAULT_TABLE table=test-table [id=c6e0298de5634d5dbd3ef3202cdb9104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:38.439808 3487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5ba13508ec4513a54e2e3fc4234cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:38.440084 2994 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5ba13508ec4513a54e2e3fc4234cd0 (DEFAULT_TABLE table=test-table [id=c6e0298de5634d5dbd3ef3202cdb9104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:38.441208 2994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5ba13508ec4513a54e2e3fc4234cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:38.452629 3650 tablet_bootstrap.cc:492] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Bootstrap starting.
I20260809 22:50:38.455047 3651 tablet_bootstrap.cc:492] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Bootstrap starting.
I20260809 22:50:38.458067 3650 tablet_bootstrap.cc:654] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:38.458762 3651 tablet_bootstrap.cc:654] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:38.459281 3654 tablet_bootstrap.cc:492] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Bootstrap starting.
I20260809 22:50:38.460078 3650 log.cc:824] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:38.460539 3651 log.cc:824] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:38.462989 3654 tablet_bootstrap.cc:654] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:38.464160 3650 tablet_bootstrap.cc:492] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: No bootstrap required, opened a new log
I20260809 22:50:38.464351 3654 log.cc:824] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:38.464514 3650 ts_tablet_manager.cc:1397] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260809 22:50:38.466153 3651 tablet_bootstrap.cc:492] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: No bootstrap required, opened a new log
I20260809 22:50:38.466430 3651 ts_tablet_manager.cc:1397] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260809 22:50:38.467079 3654 tablet_bootstrap.cc:492] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: No bootstrap required, opened a new log
I20260809 22:50:38.467406 3654 ts_tablet_manager.cc:1397] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260809 22:50:38.475260 3654 raft_consensus.cc:348] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.475698 3654 raft_consensus.cc:374] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:38.475795 3654 raft_consensus.cc:729] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57511cff5c042b88bcf92f43e96dbe8, State: Initialized, Role: FOLLOWER
I20260809 22:50:38.476460 3654 consensus_queue.cc:260] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.476742 3650 raft_consensus.cc:348] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.477217 3650 raft_consensus.cc:374] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:38.477327 3650 raft_consensus.cc:729] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef6a043d74449919221b6ae22950649, State: Initialized, Role: FOLLOWER
I20260809 22:50:38.477406 3651 raft_consensus.cc:348] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.477836 3651 raft_consensus.cc:374] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:38.477941 3651 raft_consensus.cc:729] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f078d4f0c8485aa34bb06ad7063052, State: Initialized, Role: FOLLOWER
I20260809 22:50:38.478564 3654 ts_tablet_manager.cc:1428] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260809 22:50:38.478569 3651 consensus_queue.cc:260] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.479290 3352 heartbeater.cc:503] Master 127.23.131.126:39199 was elected leader, sending a full tablet report...
I20260809 22:50:38.480465 3651 ts_tablet_manager.cc:1428] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
W20260809 22:50:38.483295 3113 tablet.cc:2369] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:50:38.489614 3650 consensus_queue.cc:260] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.491379 3595 heartbeater.cc:503] Master 127.23.131.126:39199 was elected leader, sending a full tablet report...
I20260809 22:50:38.491582 3650 ts_tablet_manager.cc:1428] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Time spent starting tablet: real 0.027s user 0.011s sys 0.005s
W20260809 22:50:38.556177 3597 tablet.cc:2369] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:50:38.578284 3666 raft_consensus.cc:482] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:38.578640 3666 raft_consensus.cc:504] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.580621 3666 leader_election.cc:288] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823), d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:38.587031 3609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.580882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33823 (local address 127.23.131.67:57153)
0809 22:50:38.581098 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.581122 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.581322 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.581806 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.581811 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.581841 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:38.582063 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.582078 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.583333 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.583336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.584801 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.584815 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.586149 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.586157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.586383 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.586430 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.586563 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.586719 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":7}
I20260809 22:50:38.587028 3638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.581021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:57153 (local address 127.23.131.65:33823)
0809 22:50:38.581277 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.581283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.581307 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:50:38.581562 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.581569 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.581668 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.581760 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:38.582249 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.583139 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.584957 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.585969 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.586154 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.586232 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.586619 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.586776 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:50:38.587169 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.581337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38853 (local address 127.23.131.67:43755)
0809 22:50:38.581517 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:38.581533 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:38.581616 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:38.582030 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:38.582033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:38.582053 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:38.582272 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.582286 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.583300 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.583307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.584807 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:38.584820 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.586357 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.586364 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:38.586618 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.586653 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 22:50:38.586741 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 22:50:38.586875 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":75}
I20260809 22:50:38.587311 3646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.581498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:43755 (local address 127.23.131.66:38853)
0809 22:50:38.581701 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.581706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.581744 (+ 38us) server_negotiation.cc:407] Connection header received
0809 22:50:38.581817 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.581821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.581897 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.582001 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:38.582430 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.583123 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.585001 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.586120 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.586281 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.586366 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.586845 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.586975 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:50:38.588578 3286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5ba13508ec4513a54e2e3fc4234cd0" candidate_uuid: "0ef6a043d74449919221b6ae22950649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d57511cff5c042b88bcf92f43e96dbe8" is_pre_election: true
I20260809 22:50:38.588578 3027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5ba13508ec4513a54e2e3fc4234cd0" candidate_uuid: "0ef6a043d74449919221b6ae22950649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f078d4f0c8485aa34bb06ad7063052" is_pre_election: true
I20260809 22:50:38.589234 3027 raft_consensus.cc:2454] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ef6a043d74449919221b6ae22950649 in term 0.
I20260809 22:50:38.589236 3286 raft_consensus.cc:2454] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ef6a043d74449919221b6ae22950649 in term 0.
I20260809 22:50:38.590005 3405 leader_election.cc:302] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f078d4f0c8485aa34bb06ad7063052, 0ef6a043d74449919221b6ae22950649; no voters:
I20260809 22:50:38.590408 3666 raft_consensus.cc:2781] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:38.590591 3666 raft_consensus.cc:482] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:38.590723 3666 raft_consensus.cc:3037] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:38.593175 3666 raft_consensus.cc:504] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.593809 3666 leader_election.cc:288] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [CANDIDATE]: Term 1 election: Requested vote from peers 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823), d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:38.594292 3027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5ba13508ec4513a54e2e3fc4234cd0" candidate_uuid: "0ef6a043d74449919221b6ae22950649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f078d4f0c8485aa34bb06ad7063052"
I20260809 22:50:38.594349 3286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5ba13508ec4513a54e2e3fc4234cd0" candidate_uuid: "0ef6a043d74449919221b6ae22950649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d57511cff5c042b88bcf92f43e96dbe8"
I20260809 22:50:38.594530 3027 raft_consensus.cc:3037] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:38.594563 3286 raft_consensus.cc:3037] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:38.597287 3286 raft_consensus.cc:2454] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef6a043d74449919221b6ae22950649 in term 1.
I20260809 22:50:38.597304 3027 raft_consensus.cc:2454] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef6a043d74449919221b6ae22950649 in term 1.
I20260809 22:50:38.597755 3405 leader_election.cc:302] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f078d4f0c8485aa34bb06ad7063052, 0ef6a043d74449919221b6ae22950649; no voters:
I20260809 22:50:38.598125 3666 raft_consensus.cc:2781] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:38.598630 3666 raft_consensus.cc:686] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 1 LEADER]: Becoming Leader. State: Replica: 0ef6a043d74449919221b6ae22950649, State: Running, Role: LEADER
I20260809 22:50:38.599331 3666 consensus_queue.cc:237] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } }
I20260809 22:50:38.605492 1525 catalog_manager.cc:5495] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ef6a043d74449919221b6ae22950649 (127.23.131.67). New cstate: current_term: 1 leader_uuid: "0ef6a043d74449919221b6ae22950649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } health_report { overall_health: UNKNOWN } } }
I20260809 22:50:38.637992 3649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.631494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34740 (local address 127.23.131.67:46073)
0809 22:50:38.631744 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.631752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.631779 (+ 27us) server_negotiation.cc:407] Connection header received
0809 22:50:38.631889 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.631896 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.632033 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.632212 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:38.632532 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.633622 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.635134 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.635836 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.635976 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.636609 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:38.637272 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:38.637430 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.637597 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.637692 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 22:50:38.644745 3357 tablet.cc:2369] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:50:38.647372 3286 raft_consensus.cc:1261] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Refusing update from remote peer 0ef6a043d74449919221b6ae22950649: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:38.647575 3027 raft_consensus.cc:1261] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Refusing update from remote peer 0ef6a043d74449919221b6ae22950649: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:38.648468 3666 consensus_queue.cc:1035] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:38.648854 3668 consensus_queue.cc:1035] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:38.686466 1525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:38.686841 1525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:38.694916 1525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f98f8157bcb4ce7800125df30f229f8: Sending DeleteTablet for 3 replicas of tablet 9d5ba13508ec4513a54e2e3fc4234cd0
I20260809 22:50:38.696270 2994 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5ba13508ec4513a54e2e3fc4234cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:38 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:53204
I20260809 22:50:38.696753 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5ba13508ec4513a54e2e3fc4234cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:38 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:49054
I20260809 22:50:38.697666 3487 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5ba13508ec4513a54e2e3fc4234cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:38 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:34730
I20260809 22:50:38.703845 3687 tablet_replica.cc:330] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: stopping tablet replica
I20260809 22:50:38.704475 3687 raft_consensus.cc:2229] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:38.705135 3687 raft_consensus.cc:2258] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:38.711997 3691 tablet_replica.cc:330] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: stopping tablet replica
I20260809 22:50:38.712661 3691 raft_consensus.cc:2229] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:38.713578 3691 raft_consensus.cc:2258] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:38.714571 3688 tablet_replica.cc:330] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: stopping tablet replica
I20260809 22:50:38.715135 3688 raft_consensus.cc:2229] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:38.716178 3687 ts_tablet_manager.cc:1905] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:38.716663 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 1466
I20260809 22:50:38.718291 3688 raft_consensus.cc:2258] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:38.719831 1580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:38.720739 3688 ts_tablet_manager.cc:1905] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:38.720944 3691 ts_tablet_manager.cc:1905] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:38.730326 3691 ts_tablet_manager.cc:1918] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:38.730530 3691 log.cc:1196] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/9d5ba13508ec4513a54e2e3fc4234cd0
I20260809 22:50:38.731146 3691 ts_tablet_manager.cc:1939] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 0ef6a043d74449919221b6ae22950649: Deleting consensus metadata
I20260809 22:50:38.731565 3687 ts_tablet_manager.cc:1918] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:38.731763 3687 log.cc:1196] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/9d5ba13508ec4513a54e2e3fc4234cd0
I20260809 22:50:38.732414 3687 ts_tablet_manager.cc:1939] T 9d5ba13508ec4513a54e2e3fc4234cd0 P 06f078d4f0c8485aa34bb06ad7063052: Deleting consensus metadata
I20260809 22:50:38.734673 3688 ts_tablet_manager.cc:1918] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:38.735186 3688 log.cc:1196] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/9d5ba13508ec4513a54e2e3fc4234cd0
I20260809 22:50:38.735826 3688 ts_tablet_manager.cc:1939] T 9d5ba13508ec4513a54e2e3fc4234cd0 P d57511cff5c042b88bcf92f43e96dbe8: Deleting consensus metadata
I20260809 22:50:38.742309 3603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.706526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53806 (local address 127.23.131.125:45835)
0809 22:50:38.706718 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.706724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.715025 (+ 8301us) server_negotiation.cc:407] Connection header received
0809 22:50:38.715315 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.715323 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.715419 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.715525 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.718099 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.719646 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.723640 (+ 3994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.724321 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.724458 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.733940 (+ 9482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.733947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.733952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.734010 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.738880 (+ 4870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.739788 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.739797 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.739803 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.740065 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.740534 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.740542 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.740546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.741000 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.741263 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.741686 (+ 423us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.741931 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 22:50:38.756129 3623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.715408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.23.131.124:37863)
0809 22:50:38.715614 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.715620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.742533 (+ 26913us) server_negotiation.cc:407] Connection header received
0809 22:50:38.742615 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.742620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.742730 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.742837 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.744578 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.745697 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.746950 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.747665 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.747803 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.750390 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.750396 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.750400 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.750435 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.753197 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.753869 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.753876 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.753880 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.754027 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.754432 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.754438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.754441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.754723 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.755018 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.755621 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.755871 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:50:38.907938 1496 catalog_manager.cc:4841] TS 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073): tablet 9d5ba13508ec4513a54e2e3fc4234cd0 (table test-table [id=c6e0298de5634d5dbd3ef3202cdb9104]) successfully deleted
W20260809 22:50:38.908341 1496 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.131.67:46073, user_credentials={real_user=slave}} blocked reactor thread for 175057us
I20260809 22:50:38.908763 1498 catalog_manager.cc:4841] TS 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823): tablet 9d5ba13508ec4513a54e2e3fc4234cd0 (table test-table [id=c6e0298de5634d5dbd3ef3202cdb9104]) successfully deleted
W20260809 22:50:38.908923 1498 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.131.65:33823, user_credentials={real_user=slave}} blocked reactor thread for 174062us
I20260809 22:50:38.909353 1498 catalog_manager.cc:4841] TS d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853): tablet 9d5ba13508ec4513a54e2e3fc4234cd0 (table test-table [id=c6e0298de5634d5dbd3ef3202cdb9104]) successfully deleted
I20260809 22:50:38.909466 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 1466
I20260809 22:50:38.980562 3623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.951234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52384 (local address 127.23.131.124:37863)
0809 22:50:38.951785 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.951792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.961695 (+ 9903us) server_negotiation.cc:407] Connection header received
0809 22:50:38.961935 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.961941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.962028 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.962104 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.964450 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.965591 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.967863 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.968555 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.968647 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.972894 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.972901 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.972907 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.972952 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.976643 (+ 3691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.977668 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.977674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.977678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.977833 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.978321 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.978326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.978330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.978732 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.979286 (+ 554us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.979942 (+ 656us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.980191 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394}
I20260809 22:50:38.981462 3603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:38.950464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53814 (local address 127.23.131.125:45835)
0809 22:50:38.950714 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:38.950724 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:38.960602 (+ 9878us) server_negotiation.cc:407] Connection header received
0809 22:50:38.961044 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:38.961054 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:38.961175 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:38.961273 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:38.964002 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.965228 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.967432 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:38.968175 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:38.968308 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:38.973039 (+ 4731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:38.973049 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:38.973056 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:38.973120 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:38.977646 (+ 4526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.978666 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.978672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.978676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.978906 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:38.979444 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:38.979450 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:38.979454 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:38.979881 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:38.980147 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:38.980797 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 22:50:38.981069 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 22:50:39.675755 3713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:39.674759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:59421)
0809 22:50:39.675365 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:39.675524 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":309,"threads_started":1}
W20260809 22:50:39.676223 3352 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:39199 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:39.678896 3716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:39.677906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:45031)
0809 22:50:39.678498 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:39.678676 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":312,"threads_started":1}
W20260809 22:50:39.679389 3595 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:39199 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:39.688941 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:39.687969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:43927)
0809 22:50:39.688537 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:39.688709 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":290,"threads_started":1}
W20260809 22:50:39.689385 3108 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:39199 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:40.194370 3718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f98f8157bcb4ce7800125df30f229f8)
I20260809 22:50:40.194443 3719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f98f8157bcb4ce7800125df30f229f8)
I20260809 22:50:40.194710 3718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } }
I20260809 22:50:40.194746 3719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } }
I20260809 22:50:40.196224 3719 leader_election.cc:288] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199), 821399bff72e43359c887b2bb5b8f167 (127.23.131.124:37863)
I20260809 22:50:40.196269 3718 leader_election.cc:288] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199), 36ebe0117f0d431e81a329b235a775c0 (127.23.131.125:45835)
I20260809 22:50:40.202973 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.196362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35860)
0809 22:50:40.202465 (+ 6103us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.202686 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5936,"thread_start_us":5769,"threads_started":1}
I20260809 22:50:40.203311 3725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.196386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35868)
0809 22:50:40.202807 (+ 6421us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.203008 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6280,"threads_started":1}
W20260809 22:50:40.204380 2485 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:40.211830 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.208600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35872)
0809 22:50:40.210825 (+ 2225us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.210944 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2085,"threads_started":1}
W20260809 22:50:40.211979 2791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
W20260809 22:50:40.218164 2485 leader_election.cc:334] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199): Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:40.220263 3723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.219646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35896)
0809 22:50:40.219822 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.220006 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 22:50:40.220474 2791 leader_election.cc:334] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199): Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:40.221101 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.196856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:37863 (local address 127.0.0.1:52388)
0809 22:50:40.210534 (+ 13678us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.210561 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.210760 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.211618 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.211623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.211651 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.212061 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.212076 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.214179 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.214188 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.217260 (+ 3072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.217283 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.220168 (+ 2885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.220175 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.220382 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.220431 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.220529 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.220652 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13506,"thread_start_us":13327,"threads_started":1}
I20260809 22:50:40.221329 3727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.202841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52388 (local address 127.23.131.124:37863)
0809 22:50:40.209978 (+ 7137us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.209988 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.211022 (+ 1034us) server_negotiation.cc:407] Connection header received
0809 22:50:40.211121 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.211129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.211247 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.211359 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.212287 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.213947 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.217502 (+ 3555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.219791 (+ 2289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.219977 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.220060 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.220810 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.220951 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6936,"thread_start_us":8039,"threads_started":1}
I20260809 22:50:40.221944 2825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "36ebe0117f0d431e81a329b235a775c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "821399bff72e43359c887b2bb5b8f167" is_pre_election: true
I20260809 22:50:40.222313 2825 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36ebe0117f0d431e81a329b235a775c0 in term 1.
I20260809 22:50:40.222931 2486 leader_election.cc:302] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36ebe0117f0d431e81a329b235a775c0, 821399bff72e43359c887b2bb5b8f167; no voters: 5f98f8157bcb4ce7800125df30f229f8
I20260809 22:50:40.223335 3719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 22:50:40.223505 3719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f98f8157bcb4ce7800125df30f229f8)
I20260809 22:50:40.223616 3719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 1 FOLLOWER]: Advancing to term 2
I20260809 22:50:40.226715 3725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.196778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:45835 (local address 127.0.0.1:53830)
0809 22:50:40.203727 (+ 6949us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.203752 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.203938 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.220283 (+ 16345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.220289 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.220343 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.220681 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.220693 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.222576 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.222581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.224347 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.224362 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.226144 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.226149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.226299 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.226324 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.226404 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.226519 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6816,"thread_start_us":5724,"threads_started":1}
I20260809 22:50:40.227063 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.210529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53830 (local address 127.23.131.125:45835)
0809 22:50:40.219820 (+ 9291us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.219826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.219848 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:50:40.219907 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.219911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.219988 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.220834 (+ 846us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.221103 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.222318 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.224542 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.225944 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.226120 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.226195 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.226452 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.226589 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9158,"thread_start_us":9508,"threads_started":1}
I20260809 22:50:40.226976 3719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } }
I20260809 22:50:40.227847 3719 leader_election.cc:288] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [CANDIDATE]: Term 2 election: Requested vote from peers 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199), 821399bff72e43359c887b2bb5b8f167 (127.23.131.124:37863)
I20260809 22:50:40.227783 2517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "821399bff72e43359c887b2bb5b8f167" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "36ebe0117f0d431e81a329b235a775c0" is_pre_election: true
I20260809 22:50:40.228269 2517 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 821399bff72e43359c887b2bb5b8f167 in current term 2: Already voted for candidate 36ebe0117f0d431e81a329b235a775c0 in this term.
I20260809 22:50:40.228320 2825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "36ebe0117f0d431e81a329b235a775c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "821399bff72e43359c887b2bb5b8f167"
I20260809 22:50:40.228580 2825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 1 FOLLOWER]: Advancing to term 2
I20260809 22:50:40.228631 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.228100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35902)
0809 22:50:40.228329 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.228435 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 22:50:40.228999 2790 leader_election.cc:302] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 821399bff72e43359c887b2bb5b8f167; no voters: 36ebe0117f0d431e81a329b235a775c0, 5f98f8157bcb4ce7800125df30f229f8
I20260809 22:50:40.229763 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.229320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35914)
0809 22:50:40.229527 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.229618 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260809 22:50:40.230000 2485 leader_election.cc:334] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199): Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
I20260809 22:50:40.231330 2825 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36ebe0117f0d431e81a329b235a775c0 in term 2.
I20260809 22:50:40.231557 3718 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 22:50:40.231815 2486 leader_election.cc:302] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36ebe0117f0d431e81a329b235a775c0, 821399bff72e43359c887b2bb5b8f167; no voters: 5f98f8157bcb4ce7800125df30f229f8
I20260809 22:50:40.232105 3719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 22:50:40.232635 3719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [term 2 LEADER]: Becoming Leader. State: Replica: 36ebe0117f0d431e81a329b235a775c0, State: Running, Role: LEADER
I20260809 22:50:40.233024 3719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } }
I20260809 22:50:40.235548 3737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36ebe0117f0d431e81a329b235a775c0. Latest consensus state: current_term: 2 leader_uuid: "36ebe0117f0d431e81a329b235a775c0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:40.235895 3737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:40.236721 3740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:40.240557 3740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:40.241457 3740 catalog_manager.cc:1259] Loaded cluster ID: 9c762ffd42c041bbbd17237e77cd20a7
I20260809 22:50:40.241531 3740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:40.242753 3740 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:40.243639 3740 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Loaded TSK: 0
I20260809 22:50:40.244475 3740 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:50:40.276336 2504 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:40.283968 2504 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:40.289081 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.288594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35926)
0809 22:50:40.288820 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.288922 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 22:50:40.289494 2825 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [term 2 FOLLOWER]: Refusing update from remote peer 36ebe0117f0d431e81a329b235a775c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 22:50:40.290354 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.289941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35942)
0809 22:50:40.290117 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.290187 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 22:50:40.290455 3737 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 22:50:40.290802 2485 consensus_peers.cc:487] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 -> Peer 5f98f8157bcb4ce7800125df30f229f8 (127.23.131.126:39199): Couldn't send request to peer 5f98f8157bcb4ce7800125df30f229f8. Status: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 22:50:40.293254 3718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36ebe0117f0d431e81a329b235a775c0. Latest consensus state: current_term: 2 leader_uuid: "36ebe0117f0d431e81a329b235a775c0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:40.293609 3718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:50:40.294838 3742 mvcc.cc:205] Tried to move back new op lower bound from 7316749681815384064 to 7316749681598427136. Current Snapshot: MvccSnapshot[applied={T|T < 7316749681815384064}]
I20260809 22:50:40.295374 3737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "36ebe0117f0d431e81a329b235a775c0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:40.295681 3737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:40.296245 3718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "36ebe0117f0d431e81a329b235a775c0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5f98f8157bcb4ce7800125df30f229f8" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39199 } } peers { permanent_uuid: "36ebe0117f0d431e81a329b235a775c0" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 45835 } attrs { promote: false } } peers { permanent_uuid: "821399bff72e43359c887b2bb5b8f167" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 37863 } attrs { promote: false } } }
I20260809 22:50:40.296551 3718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 821399bff72e43359c887b2bb5b8f167 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:50:40.311896 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.305187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46073 (local address 127.0.0.1:34746)
0809 22:50:40.305374 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.305397 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.305523 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.306168 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.306175 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.306205 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.306443 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.306461 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.308142 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.308147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.309772 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.309785 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.311239 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.311248 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.311435 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.311477 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.311567 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.311683 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 22:50:40.313000 3749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.305276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34746 (local address 127.23.131.67:46073)
0809 22:50:40.305799 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.305805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.305824 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:50:40.305894 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.305899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.305998 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.306611 (+ 613us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.306823 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.307956 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.309942 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.311043 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.312292 (+ 1249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.312423 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.312482 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.312645 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":312,"threads_started":1}
I20260809 22:50:40.313797 3487 tablet_service.cc:1467] Processing CreateTablet for tablet f0c38b0c780345d5b6197108266491fc (DEFAULT_TABLE table=test-table [id=ba0f43adda974eb48ac19879a148dcd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:40.314328 3487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0c38b0c780345d5b6197108266491fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:40.315696 3731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.305851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38853 (local address 127.0.0.1:49056)
0809 22:50:40.306515 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.306534 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.306654 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.307134 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.307139 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.307167 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.307653 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.307665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.309255 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.309264 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.312288 (+ 3024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.312310 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.314570 (+ 2260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.314577 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.314748 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.314785 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.315194 (+ 409us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.315372 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521}
I20260809 22:50:40.316684 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.306004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49056 (local address 127.23.131.66:38853)
0809 22:50:40.306797 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.306803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.306820 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:50:40.306893 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.306900 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.306973 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.307818 (+ 845us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.307978 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.309094 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.312522 (+ 3428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.314306 (+ 1784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.316035 (+ 1729us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.316157 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.316214 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.316366 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":544,"threads_started":1}
I20260809 22:50:40.317581 3256 tablet_service.cc:1467] Processing CreateTablet for tablet f0c38b0c780345d5b6197108266491fc (DEFAULT_TABLE table=test-table [id=ba0f43adda974eb48ac19879a148dcd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:40.318264 3256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0c38b0c780345d5b6197108266491fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:40.321142 3752 tablet_bootstrap.cc:492] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Bootstrap starting.
I20260809 22:50:40.322777 3752 tablet_bootstrap.cc:654] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:40.323837 3753 tablet_bootstrap.cc:492] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Bootstrap starting.
I20260809 22:50:40.325507 3752 tablet_bootstrap.cc:492] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: No bootstrap required, opened a new log
I20260809 22:50:40.325678 3752 ts_tablet_manager.cc:1397] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 22:50:40.326387 3752 raft_consensus.cc:348] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.326613 3752 raft_consensus.cc:374] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:40.326705 3752 raft_consensus.cc:729] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef6a043d74449919221b6ae22950649, State: Initialized, Role: FOLLOWER
I20260809 22:50:40.326987 3753 tablet_bootstrap.cc:654] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:40.326951 3752 consensus_queue.cc:260] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.327917 3752 ts_tablet_manager.cc:1428] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 22:50:40.330561 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.306195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33823 (local address 127.0.0.1:53214)
0809 22:50:40.306892 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.306911 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.307020 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.323465 (+ 16445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.323481 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.323526 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.323838 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.323853 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.325181 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.325186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.327237 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.327257 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.329417 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.329427 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.329735 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.329799 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.329892 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.330108 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569}
I20260809 22:50:40.332937 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.306403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53214 (local address 127.23.131.65:33823)
0809 22:50:40.318736 (+ 12333us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.318744 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.318767 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:50:40.318848 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.318854 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.318942 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.319074 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.324058 (+ 4984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.325031 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.327485 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.329082 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.331012 (+ 1930us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.331191 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.331287 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.331514 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12185,"thread_start_us":12816,"threads_started":1}
I20260809 22:50:40.333909 2994 tablet_service.cc:1467] Processing CreateTablet for tablet f0c38b0c780345d5b6197108266491fc (DEFAULT_TABLE table=test-table [id=ba0f43adda974eb48ac19879a148dcd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:40.334409 2994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0c38b0c780345d5b6197108266491fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:40.335536 3753 tablet_bootstrap.cc:492] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: No bootstrap required, opened a new log
I20260809 22:50:40.335697 3753 ts_tablet_manager.cc:1397] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260809 22:50:40.336588 3753 raft_consensus.cc:348] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.336836 3753 raft_consensus.cc:374] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:40.336930 3753 raft_consensus.cc:729] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57511cff5c042b88bcf92f43e96dbe8, State: Initialized, Role: FOLLOWER
I20260809 22:50:40.337224 3753 consensus_queue.cc:260] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.338943 3596 heartbeater.cc:503] Master 127.23.131.125:45835 was elected leader, sending a full tablet report...
I20260809 22:50:40.342271 3753 ts_tablet_manager.cc:1428] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260809 22:50:40.342850 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.328497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:59493)
0809 22:50:40.342272 (+ 13775us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.342510 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13640,"thread_start_us":13512,"threads_started":1}
I20260809 22:50:40.343976 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.343566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:47733)
0809 22:50:40.343768 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.343846 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260809 22:50:40.345367 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.343537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:35089)
0809 22:50:40.344884 (+ 1347us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.345084 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1184,"thread_start_us":1020,"threads_started":1}
I20260809 22:50:40.346076 3766 tablet_bootstrap.cc:492] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Bootstrap starting.
I20260809 22:50:40.346851 3356 heartbeater.cc:503] Master 127.23.131.125:45835 was elected leader, sending a full tablet report...
I20260809 22:50:40.347711 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.347358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:60387)
0809 22:50:40.347496 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.347585 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 22:50:40.348076 3766 tablet_bootstrap.cc:654] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:40.350347 3766 tablet_bootstrap.cc:492] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: No bootstrap required, opened a new log
I20260809 22:50:40.350536 3766 ts_tablet_manager.cc:1397] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 22:50:40.351289 3766 raft_consensus.cc:348] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.351554 3766 raft_consensus.cc:374] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:40.351672 3766 raft_consensus.cc:729] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f078d4f0c8485aa34bb06ad7063052, State: Initialized, Role: FOLLOWER
I20260809 22:50:40.351927 3766 consensus_queue.cc:260] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.352751 3766 ts_tablet_manager.cc:1428] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 22:50:40.354126 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.353032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:40239)
0809 22:50:40.353668 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.353828 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":327,"threads_started":1}
I20260809 22:50:40.354888 3111 heartbeater.cc:503] Master 127.23.131.125:45835 was elected leader, sending a full tablet report...
I20260809 22:50:40.355443 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.355028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:51425)
0809 22:50:40.355191 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.355298 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 22:50:40.713845 3768 raft_consensus.cc:482] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:40.714107 3768 raft_consensus.cc:504] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.715873 3768 leader_election.cc:288] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073), d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:40.722827 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.716377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:60071 (local address 127.23.131.66:38853)
0809 22:50:40.716671 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.716682 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.717207 (+ 525us) server_negotiation.cc:407] Connection header received
0809 22:50:40.717403 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.717407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.717467 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.717562 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.718094 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.718825 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.720851 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.721650 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.721850 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.721933 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.722313 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.722432 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:50:40.722879 3770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.716204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38853 (local address 127.23.131.65:60071)
0809 22:50:40.717104 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.717117 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.717258 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.717602 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.717607 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.717632 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.717952 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.717960 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.718965 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.718973 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.720680 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.720694 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.721883 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.721890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.722094 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.722145 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.722252 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.722405 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":164,"thread_start_us":462,"threads_started":1}
I20260809 22:50:40.722977 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.716186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:46073 (local address 127.23.131.65:44087)
0809 22:50:40.716580 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.716624 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:40.716838 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:40.717299 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:40.717305 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:40.717344 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:40.717635 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.717645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.718783 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.718789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.720855 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:40.720869 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.722209 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.722218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:40.722422 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.722453 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 22:50:40.722543 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 22:50:40.722684 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":28}
I20260809 22:50:40.723176 3749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.716263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:44087 (local address 127.23.131.67:46073)
0809 22:50:40.716496 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.716503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.716710 (+ 207us) server_negotiation.cc:407] Connection header received
0809 22:50:40.717054 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.717059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.717145 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.717272 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:40.717843 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.718630 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.721025 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.721964 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.722137 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.722193 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.722693 (+ 500us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.722845 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 22:50:40.723793 3286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0c38b0c780345d5b6197108266491fc" candidate_uuid: "06f078d4f0c8485aa34bb06ad7063052" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d57511cff5c042b88bcf92f43e96dbe8" is_pre_election: true
I20260809 22:50:40.724081 3286 raft_consensus.cc:2454] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f078d4f0c8485aa34bb06ad7063052 in term 0.
I20260809 22:50:40.724071 3521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0c38b0c780345d5b6197108266491fc" candidate_uuid: "06f078d4f0c8485aa34bb06ad7063052" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ef6a043d74449919221b6ae22950649" is_pre_election: true
I20260809 22:50:40.724555 3521 raft_consensus.cc:2454] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f078d4f0c8485aa34bb06ad7063052 in term 0.
I20260809 22:50:40.724678 2919 leader_election.cc:302] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f078d4f0c8485aa34bb06ad7063052, d57511cff5c042b88bcf92f43e96dbe8; no voters:
I20260809 22:50:40.725175 3768 raft_consensus.cc:2781] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:40.725327 3768 raft_consensus.cc:482] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:40.725438 3768 raft_consensus.cc:3037] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:40.727986 3768 raft_consensus.cc:504] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.728905 3768 leader_election.cc:288] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [CANDIDATE]: Term 1 election: Requested vote from peers 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073), d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853)
I20260809 22:50:40.729429 3521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0c38b0c780345d5b6197108266491fc" candidate_uuid: "06f078d4f0c8485aa34bb06ad7063052" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ef6a043d74449919221b6ae22950649"
I20260809 22:50:40.729496 3286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0c38b0c780345d5b6197108266491fc" candidate_uuid: "06f078d4f0c8485aa34bb06ad7063052" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d57511cff5c042b88bcf92f43e96dbe8"
I20260809 22:50:40.729630 3521 raft_consensus.cc:3037] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:40.729789 3286 raft_consensus.cc:3037] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:40.731953 3521 raft_consensus.cc:2454] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f078d4f0c8485aa34bb06ad7063052 in term 1.
I20260809 22:50:40.732191 3286 raft_consensus.cc:2454] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f078d4f0c8485aa34bb06ad7063052 in term 1.
I20260809 22:50:40.732417 2916 leader_election.cc:302] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f078d4f0c8485aa34bb06ad7063052, 0ef6a043d74449919221b6ae22950649; no voters:
I20260809 22:50:40.732769 3768 raft_consensus.cc:2781] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:40.733249 3768 raft_consensus.cc:686] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 1 LEADER]: Becoming Leader. State: Replica: 06f078d4f0c8485aa34bb06ad7063052, State: Running, Role: LEADER
I20260809 22:50:40.733649 3768 consensus_queue.cc:237] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } }
I20260809 22:50:40.734920 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.734303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:57631)
0809 22:50:40.734588 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.734721 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260809 22:50:40.737763 2505 catalog_manager.cc:5495] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65). New cstate: current_term: 1 leader_uuid: "06f078d4f0c8485aa34bb06ad7063052" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06f078d4f0c8485aa34bb06ad7063052" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33823 } health_report { overall_health: HEALTHY } } }
I20260809 22:50:40.778096 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.772130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53230 (local address 127.23.131.65:33823)
0809 22:50:40.772401 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.772410 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.772743 (+ 333us) server_negotiation.cc:407] Connection header received
0809 22:50:40.773012 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.773018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.773127 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.773310 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:40.773749 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.774464 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.775848 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.776322 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.776476 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.776906 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:40.777463 (+ 557us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:40.777622 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.777725 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.777813 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 22:50:40.782428 3286 raft_consensus.cc:1261] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Refusing update from remote peer 06f078d4f0c8485aa34bb06ad7063052: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:40.782862 3521 raft_consensus.cc:1261] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Refusing update from remote peer 06f078d4f0c8485aa34bb06ad7063052: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:40.783358 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.782772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35948)
0809 22:50:40.783008 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.783119 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 22:50:40.783311 3771 consensus_queue.cc:1035] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d57511cff5c042b88bcf92f43e96dbe8" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:40.784065 3768 consensus_queue.cc:1035] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef6a043d74449919221b6ae22950649" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:40.784576 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.784123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.0.0.1:35952)
0809 22:50:40.784349 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.784429 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260809 22:50:40.786603 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.785941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:55983)
0809 22:50:40.786200 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.786354 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260809 22:50:40.787638 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.787102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:33103)
0809 22:50:40.787304 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.787425 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 22:50:40.790709 3778 mvcc.cc:205] Tried to move back new op lower bound from 7316749683837820928 to 7316749683649191936. Current Snapshot: MvccSnapshot[applied={T|T < 7316749683837820928}]
I20260809 22:50:40.792411 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.791839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.66:43995)
0809 22:50:40.792095 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.792207 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260809 22:50:40.803400 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.802293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:35183)
0809 22:50:40.803074 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.803171 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":623}
I20260809 22:50:40.808111 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.807533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.65:52763)
0809 22:50:40.807831 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.807939 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260809 22:50:40.810869 3781 mvcc.cc:205] Tried to move back new op lower bound from 7316749683837820928 to 7316749683649191936. Current Snapshot: MvccSnapshot[applied={T|T < 7316749683837820928}]
I20260809 22:50:40.811278 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.810534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39199 (local address 127.23.131.67:52833)
0809 22:50:40.810902 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:40.811023 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217}
I20260809 22:50:40.815577 2505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:40.815838 2505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:40.822121 2505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36ebe0117f0d431e81a329b235a775c0: Sending DeleteTablet for 3 replicas of tablet f0c38b0c780345d5b6197108266491fc
I20260809 22:50:40.823504 3487 tablet_service.cc:1514] Processing DeleteTablet for tablet f0c38b0c780345d5b6197108266491fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:40 UTC) from {username='oryx', principal='oryx/127.23.131.125@KRBTEST.COM'} at 127.0.0.1:34746
I20260809 22:50:40.823788 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet f0c38b0c780345d5b6197108266491fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:40 UTC) from {username='oryx', principal='oryx/127.23.131.125@KRBTEST.COM'} at 127.0.0.1:49056
I20260809 22:50:40.824605 3798 tablet_replica.cc:330] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: stopping tablet replica
I20260809 22:50:40.824846 3798 raft_consensus.cc:2229] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:40.825238 3798 raft_consensus.cc:2258] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:40.825245 2994 tablet_service.cc:1514] Processing DeleteTablet for tablet f0c38b0c780345d5b6197108266491fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:40 UTC) from {username='oryx', principal='oryx/127.23.131.125@KRBTEST.COM'} at 127.0.0.1:53214
I20260809 22:50:40.825549 3797 tablet_replica.cc:330] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: stopping tablet replica
I20260809 22:50:40.825766 3797 raft_consensus.cc:2229] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:40.826093 3797 raft_consensus.cc:2258] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:40.826722 3798 ts_tablet_manager.cc:1905] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:40.827030 3797 ts_tablet_manager.cc:1905] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:40.827184 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 2784
I20260809 22:50:40.834872 3799 tablet_replica.cc:330] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: stopping tablet replica
I20260809 22:50:40.835119 3799 raft_consensus.cc:2229] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:40.835882 3799 raft_consensus.cc:2258] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:40.837152 3799 ts_tablet_manager.cc:1905] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:40.838323 3797 ts_tablet_manager.cc:1918] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:40.838472 3797 log.cc:1196] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/f0c38b0c780345d5b6197108266491fc
I20260809 22:50:40.838969 3797 ts_tablet_manager.cc:1939] T f0c38b0c780345d5b6197108266491fc P 0ef6a043d74449919221b6ae22950649: Deleting consensus metadata
I20260809 22:50:40.840179 3798 ts_tablet_manager.cc:1918] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:40.840333 3798 log.cc:1196] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/f0c38b0c780345d5b6197108266491fc
I20260809 22:50:40.840999 3798 ts_tablet_manager.cc:1939] T f0c38b0c780345d5b6197108266491fc P d57511cff5c042b88bcf92f43e96dbe8: Deleting consensus metadata
I20260809 22:50:40.842489 2487 catalog_manager.cc:4841] TS d57511cff5c042b88bcf92f43e96dbe8 (127.23.131.66:38853): tablet f0c38b0c780345d5b6197108266491fc (table test-table [id=ba0f43adda974eb48ac19879a148dcd6]) successfully deleted
I20260809 22:50:40.843820 2485 catalog_manager.cc:4841] TS 0ef6a043d74449919221b6ae22950649 (127.23.131.67:46073): tablet f0c38b0c780345d5b6197108266491fc (table test-table [id=ba0f43adda974eb48ac19879a148dcd6]) successfully deleted
I20260809 22:50:40.845973 3799 ts_tablet_manager.cc:1918] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:40.846138 3799 log.cc:1196] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/f0c38b0c780345d5b6197108266491fc
I20260809 22:50:40.846688 3799 ts_tablet_manager.cc:1939] T f0c38b0c780345d5b6197108266491fc P 06f078d4f0c8485aa34bb06ad7063052: Deleting consensus metadata
I20260809 22:50:40.847931 2487 catalog_manager.cc:4841] TS 06f078d4f0c8485aa34bb06ad7063052 (127.23.131.65:33823): tablet f0c38b0c780345d5b6197108266491fc (table test-table [id=ba0f43adda974eb48ac19879a148dcd6]) successfully deleted
I20260809 22:50:40.855616 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.828055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53238 (local address 127.23.131.65:33823)
0809 22:50:40.828289 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.828299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.836633 (+ 8334us) server_negotiation.cc:407] Connection header received
0809 22:50:40.839558 (+ 2925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.839565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.839699 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.839782 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:40.842969 (+ 3187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.844157 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.845565 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.846100 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.846275 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:40.849203 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:40.849227 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:40.849242 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:40.849286 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:40.852522 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:40.853347 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:40.853356 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:40.853360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:40.853544 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:40.853916 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:40.853922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:40.853927 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:40.854434 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:40.854793 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:40.854952 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 22:50:40.855187 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:50:40.856400 3096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:40.964242 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 2784
I20260809 22:50:40.992159 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 3130
I20260809 22:50:41.007112 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:40.993066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49066 (local address 127.23.131.66:38853)
0809 22:50:40.993249 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:40.993253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:40.993273 (+ 20us) server_negotiation.cc:407] Connection header received
0809 22:50:40.993403 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:40.993406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:40.993475 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:40.993565 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:40.994954 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.995854 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.997295 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:40.997773 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:40.997919 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:41.001047 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:41.001071 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:41.001088 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:41.001134 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:41.004165 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:41.004873 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:41.004918 (+ 45us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:41.004921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:41.005082 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:41.005447 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:41.005451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:41.005453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:41.005823 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:41.006106 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:41.006456 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 22:50:41.006709 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 22:50:41.008117 3346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:41.106488 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 3130
I20260809 22:50:41.136847 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 3377
I20260809 22:50:41.151877 3749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:41.137686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34750 (local address 127.23.131.67:46073)
0809 22:50:41.137883 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:41.137890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:41.137993 (+ 103us) server_negotiation.cc:407] Connection header received
0809 22:50:41.138195 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:41.138201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:41.138310 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:41.138420 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:41.139991 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:41.140756 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:41.142147 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:41.142659 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:41.142799 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:41.145560 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:41.145587 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:41.145604 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:41.145643 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:41.148787 (+ 3144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:41.149564 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:41.149575 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:41.149579 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:41.149745 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:41.150178 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:41.150184 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:41.150188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:41.150600 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:41.150951 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:41.151283 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 22:50:41.151539 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 22:50:41.152648 3582 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:41.278702 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 3377
I20260809 22:50:41.312485 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 2298
I20260809 22:50:41.313671 2544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:41.443446 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 2298
W20260809 22:50:41.469826 2790 connection.cc:535] server connection from 127.0.0.1:52388 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 22:50:41.470245 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 2451
I20260809 22:50:41.471416 2868 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:41.600528 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 2451
2026-08-09T22:50:41Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10761 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:41 dist-test-slave-92m1 krb5kdc[3814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:41 dist-test-slave-92m1 krb5kdc[3814](info): set up 2 sockets
Aug 09 22:50:41 dist-test-slave-92m1 krb5kdc[3814](info): commencing operation
krb5kdc: starting...
W20260809 22:50:42.977006 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.003s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:43 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:43Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab.
Entry for principal oryx/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab.
I20260809 22:50:43.303505 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:36113
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab
--principal=oryx/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:36113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:43.669296 3832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:43.669730 3832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:43.669894 3832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:43.678022 3832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:43.678184 3832 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 22:50:43.678277 3832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:43.678395 3832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:43.678485 3832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:43.678596 3832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:43.689119 3832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:36113
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.126.keytab
--principal=oryx/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:36113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:43.690557 3832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:43.691938 3832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:43.704382 3840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:43.704406 3842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:43.704535 3844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:43.705646 3832 server_base.cc:1034] running on GCE node
I20260809 22:50:43.706607 3832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:43.708278 3832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:43.709529 3832 hybrid_clock.cc:648] HybridClock initialized: now 1786315843709454 us; error 38 us; skew 500 ppm
I20260809 22:50:43.709913 3832 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:43 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315843, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:43.713446 3832 init.cc:377] Logged in from keytab as oryx/127.23.131.126@KRBTEST.COM (short username oryx)
I20260809 22:50:43.715065 3832 webserver.cc:460] Webserver started at http://127.23.131.126:34037/ using document root <none> and password file <none>
I20260809 22:50:43.715890 3832 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:43.716041 3832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:43.716394 3832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:43.719820 3832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "63e6f408a910499f8d2c6499196bec28"
format_stamp: "Formatted at 2026-08-09 22:50:43 on dist-test-slave-92m1"
server_key: "09dcebc02dd2d465f2d7c30ea603919d"
server_key_iv: "2443d80ab0695031a2b72dcac6e54272"
server_key_version: "encryptionkey@0"
I20260809 22:50:43.720723 3832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "63e6f408a910499f8d2c6499196bec28"
format_stamp: "Formatted at 2026-08-09 22:50:43 on dist-test-slave-92m1"
server_key: "09dcebc02dd2d465f2d7c30ea603919d"
server_key_iv: "2443d80ab0695031a2b72dcac6e54272"
server_key_version: "encryptionkey@0"
I20260809 22:50:43.726608 3832 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:43.730485 3858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:43.731971 3832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:43.732187 3832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "63e6f408a910499f8d2c6499196bec28"
format_stamp: "Formatted at 2026-08-09 22:50:43 on dist-test-slave-92m1"
server_key: "09dcebc02dd2d465f2d7c30ea603919d"
server_key_iv: "2443d80ab0695031a2b72dcac6e54272"
server_key_version: "encryptionkey@0"
I20260809 22:50:43.732455 3832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:43.772526 3832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:43.777164 3832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:43.777501 3832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:43.801875 3832 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:36113
I20260809 22:50:43.801893 3965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:36113 every 8 connection(s)
I20260809 22:50:43.803499 3832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:43.806808 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 3832
I20260809 22:50:43.807034 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:43.807966 24077 external_mini_cluster.cc:1428] Setting key 23f6c1ea07f8fe4fd8fde9248c29bbb7
I20260809 22:50:43.808151 3966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:43.824218 3966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Bootstrap starting.
Aug 09 22:50:43 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:43.828572 3966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:43.830094 3966 log.cc:824] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:43.834010 3966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: No bootstrap required, opened a new log
I20260809 22:50:43.835629 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:43.810188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54062 (local address 127.23.131.126:36113)
0809 22:50:43.811073 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:43.811085 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:43.811130 (+ 45us) server_negotiation.cc:407] Connection header received
0809 22:50:43.813251 (+ 2121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:43.813274 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:43.813675 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:43.814020 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:43.816512 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:43.817835 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:43.819677 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:43.820502 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:43.820665 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:43.825862 (+ 5197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:43.825876 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:43.825903 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:43.825983 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:43.830313 (+ 4330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:43.831383 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:43.831390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:43.831397 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:43.831590 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:43.832110 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:43.832115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:43.832118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:43.832877 (+ 759us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:43.833215 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:43.833662 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 22:50:43.834150 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":426,"threads_started":1}
I20260809 22:50:43.843633 3966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e6f408a910499f8d2c6499196bec28" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36113 } }
I20260809 22:50:43.844059 3966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:43.844147 3966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63e6f408a910499f8d2c6499196bec28, State: Initialized, Role: FOLLOWER
I20260809 22:50:43.844709 3966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e6f408a910499f8d2c6499196bec28" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36113 } }
I20260809 22:50:43.844945 3966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:43.845065 3966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:43.845196 3966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:43.847636 3966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e6f408a910499f8d2c6499196bec28" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36113 } }
I20260809 22:50:43.848150 3966 leader_election.cc:302] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63e6f408a910499f8d2c6499196bec28; no voters:
I20260809 22:50:43.848917 3966 leader_election.cc:288] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:43.849097 3972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:43.850049 3972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [term 1 LEADER]: Becoming Leader. State: Replica: 63e6f408a910499f8d2c6499196bec28, State: Running, Role: LEADER
I20260809 22:50:43.850728 3972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e6f408a910499f8d2c6499196bec28" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36113 } }
I20260809 22:50:43.851384 3966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:43.854349 3973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63e6f408a910499f8d2c6499196bec28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e6f408a910499f8d2c6499196bec28" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36113 } } }
I20260809 22:50:43.854848 3973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:43.856926 3974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63e6f408a910499f8d2c6499196bec28. Latest consensus state: current_term: 1 leader_uuid: "63e6f408a910499f8d2c6499196bec28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e6f408a910499f8d2c6499196bec28" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36113 } } }
I20260809 22:50:43.857326 3974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:43.860590 3988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:43.866983 3988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:43.878010 3988 catalog_manager.cc:1347] Generated new cluster ID: 2ec18b26cbfa4b2a938d05707b50d4d3
I20260809 22:50:43.878161 3988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:43.898448 3988 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:43.899935 3988 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:43.913607 3988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Generated new TSK 0
I20260809 22:50:43.914562 3988 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab.
Entry for principal oryx/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab.
I20260809 22:50:43.995342 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:36113
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:44.365505 4006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:44.365851 4006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:44.365955 4006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:44.373663 4006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:44.373799 4006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:44.373888 4006 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:50:44.373978 4006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:44.384384 4006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:36113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:44.385715 4006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:44.387388 4006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:44.401762 4019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:44.401834 4027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:44.401857 4023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:44.403146 4006 server_base.cc:1034] running on GCE node
I20260809 22:50:44.403905 4006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:44.404968 4006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:44.406276 4006 hybrid_clock.cc:648] HybridClock initialized: now 1786315844406201 us; error 37 us; skew 500 ppm
I20260809 22:50:44.406648 4006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:44 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315844, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:44.410356 4006 init.cc:377] Logged in from keytab as oryx/127.23.131.65@KRBTEST.COM (short username oryx)
I20260809 22:50:44.412052 4006 webserver.cc:460] Webserver started at http://127.23.131.65:44029/ using document root <none> and password file <none>
I20260809 22:50:44.412834 4006 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:44.412982 4006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:44.413331 4006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:44.416447 4006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "eb3b46f0d70d42ed901c6cd0482ba81b"
format_stamp: "Formatted at 2026-08-09 22:50:44 on dist-test-slave-92m1"
server_key: "43e1330eb7fc57bf6a0f71e34da0b56c"
server_key_iv: "370fc59e18a608e2cc37cd466f33b3d0"
server_key_version: "encryptionkey@0"
I20260809 22:50:44.417315 4006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "eb3b46f0d70d42ed901c6cd0482ba81b"
format_stamp: "Formatted at 2026-08-09 22:50:44 on dist-test-slave-92m1"
server_key: "43e1330eb7fc57bf6a0f71e34da0b56c"
server_key_iv: "370fc59e18a608e2cc37cd466f33b3d0"
server_key_version: "encryptionkey@0"
I20260809 22:50:44.422823 4006 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:44.426651 4038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:44.428066 4006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:44.428259 4006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "eb3b46f0d70d42ed901c6cd0482ba81b"
format_stamp: "Formatted at 2026-08-09 22:50:44 on dist-test-slave-92m1"
server_key: "43e1330eb7fc57bf6a0f71e34da0b56c"
server_key_iv: "370fc59e18a608e2cc37cd466f33b3d0"
server_key_version: "encryptionkey@0"
I20260809 22:50:44.428504 4006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:44.449378 4006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:44.454064 4006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:44.454384 4006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:44.457585 4006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:44.457696 4006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:44.457828 4006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:44.457921 4006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:50:44 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315844, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:44.490562 4052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:44.458935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.23.131.65:53877)
0809 22:50:44.460327 (+ 1392us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:44.460393 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:44.463441 (+ 3048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:44.464484 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:44.464503 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:44.465585 (+ 1082us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:44.466795 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:44.466850 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.468670 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.468679 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:44.471700 (+ 3021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:44.471728 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.473080 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.473091 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:44.473503 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:44.474581 (+ 1078us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:44.474629 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:44.479189 (+ 4560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:44.485031 (+ 5842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:44.485049 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:44.485093 (+ 44us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:44.485989 (+ 896us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:44.486561 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:44.486567 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:44.486580 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:44.486866 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:44.487737 (+ 871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:44.487746 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:44.488195 (+ 449us) client_negotiation.cc:769] Sending connection context
0809 22:50:44.488631 (+ 436us) client_negotiation.cc:240] Negotiation successful
0809 22:50:44.489318 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"thread_start_us":487,"threads_started":1}
I20260809 22:50:44.492020 4051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:44.458367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53877 (local address 127.23.131.126:36113)
0809 22:50:44.460114 (+ 1747us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:44.460120 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:44.460526 (+ 406us) server_negotiation.cc:407] Connection header received
0809 22:50:44.463855 (+ 3329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:44.463864 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:44.463982 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:44.464144 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:44.467099 (+ 2955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.468419 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.471934 (+ 3515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.472748 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.472924 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:44.479693 (+ 6769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:44.479706 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:44.479715 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:44.479777 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:44.484776 (+ 4999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:44.486170 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:44.486178 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:44.486183 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:44.486377 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:44.487047 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:44.487054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:44.487060 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:44.487463 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:44.487650 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:44.491291 (+ 3641us) server_negotiation.cc:299] Negotiation successful
0809 22:50:44.491611 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1610,"thread_start_us":1490,"threads_started":1}
I20260809 22:50:44.507629 4006 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:45323
I20260809 22:50:44.507648 4243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:45323 every 8 connection(s)
I20260809 22:50:44.509265 4006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:44.515175 4244 heartbeater.cc:347] Connected to a master server at 127.23.131.126:36113
I20260809 22:50:44.515528 4244 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:44.516397 4244 heartbeater.cc:511] Master 127.23.131.126:36113 requested a full tablet report, sending...
I20260809 22:50:44.517267 4051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:44.499615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:39523 (local address 127.23.131.126:36113)
0809 22:50:44.499831 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:44.499840 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:44.501211 (+ 1371us) server_negotiation.cc:407] Connection header received
0809 22:50:44.501494 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:44.501501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:44.501588 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:44.501704 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:44.503351 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.504157 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.506730 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.507511 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.507661 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:44.510435 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:44.510441 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:44.510445 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:44.510484 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:44.514022 (+ 3538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:44.514889 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:44.514898 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:44.514903 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:44.515129 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:44.515621 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:44.515627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:44.515631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:44.515969 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:44.516131 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:44.516610 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 22:50:44.516865 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:50:44.517618 4218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:44.499687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.23.131.65:39523)
0809 22:50:44.501079 (+ 1392us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:44.501111 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:44.501297 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:44.501744 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:44.501749 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:44.502508 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:44.503079 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:44.503101 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.504440 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.504447 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:44.506470 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:44.506490 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:44.508040 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:44.508051 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:44.508288 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:44.509074 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:44.509095 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:44.510088 (+ 993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:44.514188 (+ 4100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:44.514193 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:44.514199 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:44.514756 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:44.515296 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:44.515304 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:44.515332 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:44.515491 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:44.516111 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:44.516116 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:44.516340 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 22:50:44.516497 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 22:50:44.516899 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1107,"thread_start_us":892,"threads_started":1}
I20260809 22:50:44.519105 3889 ts_manager.cc:194] Registered new tserver with Master: eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323)
I20260809 22:50:44.519677 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 4006
I20260809 22:50:44.519904 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:44.520761 24077 external_mini_cluster.cc:1428] Setting key 69cb19249dd67d9540255bc9678a9f46
I20260809 22:50:44.520766 3889 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:53877
WARNING: no policy specified for oryx/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab.
Entry for principal oryx/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab.
I20260809 22:50:44.590103 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:36113
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:44.952314 4250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:44.952721 4250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:44.952901 4250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:44.961135 4250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:44.961310 4250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:44.961474 4250 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:50:44.961663 4250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:44.978780 4250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:36113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:44.980696 4250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:44.982504 4250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:45.003686 4257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:45.003719 4258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:45.004588 4262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:45.005571 4250 server_base.cc:1034] running on GCE node
I20260809 22:50:45.006645 4250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:45.008245 4250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:45.009505 4250 hybrid_clock.cc:648] HybridClock initialized: now 1786315845009361 us; error 107 us; skew 500 ppm
I20260809 22:50:45.009884 4250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315845, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:45.014750 4250 init.cc:377] Logged in from keytab as oryx/127.23.131.66@KRBTEST.COM (short username oryx)
I20260809 22:50:45.016563 4250 webserver.cc:460] Webserver started at http://127.23.131.66:40849/ using document root <none> and password file <none>
I20260809 22:50:45.017570 4250 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:45.017700 4250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:45.018115 4250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:45.022637 4250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "ec0c5af6c0af4aef933eb25461e459e4"
format_stamp: "Formatted at 2026-08-09 22:50:45 on dist-test-slave-92m1"
server_key: "5c13f31d9de6b7eff1a66f60c5fb9a88"
server_key_iv: "cae62bf87087b755854fe864c5f6d769"
server_key_version: "encryptionkey@0"
I20260809 22:50:45.023656 4250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "ec0c5af6c0af4aef933eb25461e459e4"
format_stamp: "Formatted at 2026-08-09 22:50:45 on dist-test-slave-92m1"
server_key: "5c13f31d9de6b7eff1a66f60c5fb9a88"
server_key_iv: "cae62bf87087b755854fe864c5f6d769"
server_key_version: "encryptionkey@0"
I20260809 22:50:45.029724 4250 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 22:50:45.033744 4275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:45.035194 4250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:50:45.035473 4250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "ec0c5af6c0af4aef933eb25461e459e4"
format_stamp: "Formatted at 2026-08-09 22:50:45 on dist-test-slave-92m1"
server_key: "5c13f31d9de6b7eff1a66f60c5fb9a88"
server_key_iv: "cae62bf87087b755854fe864c5f6d769"
server_key_version: "encryptionkey@0"
I20260809 22:50:45.035722 4250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:45.062212 4250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:45.066804 4250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:45.067140 4250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:45.070199 4250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:45.070327 4250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:45.070478 4250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:45.070557 4250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315845, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:45.096258 4286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.071155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:60187 (local address 127.23.131.126:36113)
0809 22:50:45.071712 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.071716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.073000 (+ 1284us) server_negotiation.cc:407] Connection header received
0809 22:50:45.075133 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.075139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.075277 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.075397 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:45.077913 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.079410 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.082344 (+ 2934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.083043 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.083274 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.088340 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:45.088345 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:45.088349 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:45.088385 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:45.091836 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.093247 (+ 1411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.093253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.093257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.093452 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.094097 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.094104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.094113 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.094481 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:45.094651 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.095532 (+ 881us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.095804 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":293,"threads_started":1}
I20260809 22:50:45.097856 4287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.071863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.23.131.66:60187)
0809 22:50:45.072795 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.072839 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.074839 (+ 2000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.075715 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.075732 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.076601 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:45.077579 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.077604 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.079603 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.079611 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.082179 (+ 2568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.082193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.083417 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.083425 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.083714 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.084657 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:45.084703 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:45.088088 (+ 3385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:45.092081 (+ 3993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.092093 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.092113 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.093022 (+ 909us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.093648 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.093653 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.093657 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.093932 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.094629 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:45.094638 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:45.095069 (+ 431us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.095439 (+ 370us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.096119 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":360,"threads_started":1}
I20260809 22:50:45.118383 4250 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:38381
I20260809 22:50:45.118402 4475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:38381 every 8 connection(s)
I20260809 22:50:45.119961 4250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:45.122491 4476 heartbeater.cc:347] Connected to a master server at 127.23.131.126:36113
I20260809 22:50:45.122558 4427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.105756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.23.131.66:38555)
0809 22:50:45.106448 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.106471 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.106672 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.107133 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.107138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.107890 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:45.108416 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.108433 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.110101 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.110109 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.111894 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.111911 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.113212 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.113224 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.113485 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.114282 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:45.114316 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:45.115800 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:45.119349 (+ 3549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.119355 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.119359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.119852 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.120318 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.120323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.120327 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.120487 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.121327 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:45.121335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:45.121572 (+ 237us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.121691 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.122018 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":349,"threads_started":1}
I20260809 22:50:45.122856 4476 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:45.123370 4286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.105928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:38555 (local address 127.23.131.126:36113)
0809 22:50:45.106099 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.106103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.106581 (+ 478us) server_negotiation.cc:407] Connection header received
0809 22:50:45.106866 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.106871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.106963 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.107088 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:45.108617 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.109909 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.112154 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.112768 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.112907 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.116022 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:45.116027 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:45.116030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:45.116064 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:45.119145 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.120002 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.120014 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.120016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.120195 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.120617 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.120622 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.120626 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.121171 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:45.122558 (+ 1387us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.122718 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.123015 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 22:50:45.123791 4476 heartbeater.cc:511] Master 127.23.131.126:36113 requested a full tablet report, sending...
I20260809 22:50:45.125437 3887 ts_manager.cc:194] Registered new tserver with Master: ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381)
I20260809 22:50:45.126600 3887 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:60187
I20260809 22:50:45.129379 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 4250
I20260809 22:50:45.129601 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:45.130097 24077 external_mini_cluster.cc:1428] Setting key 7639d937b7cc9dc5db8c454aefd1b0a2
WARNING: no policy specified for oryx/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab.
Entry for principal oryx/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab.
I20260809 22:50:45.198743 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:36113
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:50:45.524350 4244 heartbeater.cc:503] Master 127.23.131.126:36113 was elected leader, sending a full tablet report...
W20260809 22:50:45.572219 4482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:45.572548 4482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:45.572757 4482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:45.580451 4482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:45.580574 4482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:45.580756 4482 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 22:50:45.580881 4482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:45.591400 4482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.131.126:36113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:45.592852 4482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:45.594393 4482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:45.609215 4501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:45.609280 4493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:45.609249 4495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:45.610240 4482 server_base.cc:1034] running on GCE node
I20260809 22:50:45.611042 4482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:45.612147 4482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:45.613422 4482 hybrid_clock.cc:648] HybridClock initialized: now 1786315845613335 us; error 63 us; skew 500 ppm
I20260809 22:50:45.613781 4482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315845, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:45.617437 4482 init.cc:377] Logged in from keytab as oryx/127.23.131.67@KRBTEST.COM (short username oryx)
I20260809 22:50:45.619167 4482 webserver.cc:460] Webserver started at http://127.23.131.67:42579/ using document root <none> and password file <none>
I20260809 22:50:45.619997 4482 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:45.620098 4482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:45.620389 4482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:45.623999 4482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "3b67e4b0a84440d58debdfdce88d532b"
format_stamp: "Formatted at 2026-08-09 22:50:45 on dist-test-slave-92m1"
server_key: "800e2fa54ba2f6f0d05c702c8590eee2"
server_key_iv: "d9997ef2c2c7ee23c4ce883276a21d2d"
server_key_version: "encryptionkey@0"
I20260809 22:50:45.624840 4482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "3b67e4b0a84440d58debdfdce88d532b"
format_stamp: "Formatted at 2026-08-09 22:50:45 on dist-test-slave-92m1"
server_key: "800e2fa54ba2f6f0d05c702c8590eee2"
server_key_iv: "d9997ef2c2c7ee23c4ce883276a21d2d"
server_key_version: "encryptionkey@0"
I20260809 22:50:45.630712 4482 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 22:50:45.634841 4513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:45.636485 4482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:45.636724 4482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "3b67e4b0a84440d58debdfdce88d532b"
format_stamp: "Formatted at 2026-08-09 22:50:45 on dist-test-slave-92m1"
server_key: "800e2fa54ba2f6f0d05c702c8590eee2"
server_key_iv: "d9997ef2c2c7ee23c4ce883276a21d2d"
server_key_version: "encryptionkey@0"
I20260809 22:50:45.637027 4482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:45.665061 4482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:45.669440 4482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:45.669777 4482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:45.672938 4482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:45.673064 4482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:45.673242 4482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:45.673345 4482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315845, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:45.698935 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.673464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:59349 (local address 127.23.131.126:36113)
0809 22:50:45.674012 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.674021 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.675216 (+ 1195us) server_negotiation.cc:407] Connection header received
0809 22:50:45.677507 (+ 2291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.677513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.677611 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.677755 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:45.680061 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.681248 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.684143 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.684783 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.684936 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.690798 (+ 5862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:45.690804 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:45.690808 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:45.690847 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:45.694619 (+ 3772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.695871 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.695878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.695881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.696086 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.696859 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.696868 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.696872 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.697253 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:45.697421 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.698243 (+ 822us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.698503 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":279,"threads_started":1}
I20260809 22:50:45.700146 4529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.674082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.23.131.67:59349)
0809 22:50:45.675030 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.675076 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.677132 (+ 2056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.677970 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.677979 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.678848 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:45.679848 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.679887 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.681445 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.681449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.683887 (+ 2438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.683908 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.685065 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.685074 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.685430 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.686334 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:45.686385 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:45.690427 (+ 4042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:45.694812 (+ 4385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.694824 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.694847 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.695695 (+ 848us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.696294 (+ 599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.696301 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.696307 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.696668 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.697407 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:45.697417 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:45.697839 (+ 422us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.698128 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.698755 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":388,"threads_started":1}
I20260809 22:50:45.722545 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.707172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:58155 (local address 127.23.131.126:36113)
0809 22:50:45.707412 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.707420 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.708194 (+ 774us) server_negotiation.cc:407] Connection header received
0809 22:50:45.708433 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.708438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.708506 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.708616 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:45.709666 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.710413 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.712170 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.712778 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.712923 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.715611 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:45.715616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:45.715619 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:45.715683 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:45.718979 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.719967 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.719976 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.719982 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.720205 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.720772 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.720778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.720781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.721278 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:45.721458 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.721929 (+ 471us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.722179 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 22:50:45.722751 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.707174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.23.131.67:58155)
0809 22:50:45.708072 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.708095 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.708285 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.708651 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.708655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.709200 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:45.709507 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.709517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.710568 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.710573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.711936 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.711958 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.713028 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.713038 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.713214 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.713978 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:45.714000 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:45.715376 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:45.719146 (+ 3770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.719152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.719156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.719772 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.720438 (+ 666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:45.720446 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:45.720452 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:45.720645 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:45.721416 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:45.721422 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:45.721637 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.721809 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.722222 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":529,"threads_started":1}
I20260809 22:50:45.731673 4482 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:35493
I20260809 22:50:45.731727 4697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:35493 every 8 connection(s)
I20260809 22:50:45.733312 4482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:45.735644 4700 heartbeater.cc:347] Connected to a master server at 127.23.131.126:36113
I20260809 22:50:45.735944 4700 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:45.736665 4700 heartbeater.cc:511] Master 127.23.131.126:36113 requested a full tablet report, sending...
I20260809 22:50:45.738229 3887 ts_manager.cc:194] Registered new tserver with Master: 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:45.739118 3887 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:59349
I20260809 22:50:45.743599 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 4482
I20260809 22:50:45.743847 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:45.744324 24077 external_mini_cluster.cc:1428] Setting key aa24058f6188dcdafa765a06afbac4c8
I20260809 22:50:45.747701 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 22:50:45.822315 4527 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:45.809339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44636 (local address 127.23.131.126:36113)
0809 22:50:45.809622 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.809632 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.811488 (+ 1856us) server_negotiation.cc:407] Connection header received
0809 22:50:45.811644 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.811648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.811723 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.811823 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:45.813271 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.814087 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.815493 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.815902 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.816013 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.821942 (+ 5929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44636: BlockingRecv error: recv got EOF from 127.0.0.1:44636 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 22:50:45 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:45.840807 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.825805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44650 (local address 127.23.131.126:36113)
0809 22:50:45.826053 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.826062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.826300 (+ 238us) server_negotiation.cc:407] Connection header received
0809 22:50:45.826520 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.826530 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.826596 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.826704 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:45.828033 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.828767 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.830029 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.830483 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.830623 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.834790 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:45.834795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:45.834798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:45.834837 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:45.837901 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.838614 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.838620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.838623 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.838760 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:45.839179 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:45.839183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:45.839185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:45.839560 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:45.839872 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.840209 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.840462 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 22:50:45.845216 3887 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:45.852689 3887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:45.881459 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.867134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55024 (local address 127.23.131.66:38381)
0809 22:50:45.868221 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.868233 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.868862 (+ 629us) server_negotiation.cc:407] Connection header received
0809 22:50:45.869245 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.869256 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.869556 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.869760 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:45.870979 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.873054 (+ 2075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.877124 (+ 4070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.879258 (+ 2134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.879421 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.879723 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.880693 (+ 970us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.880978 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":908,"thread_start_us":762,"threads_started":1}
I20260809 22:50:45.882958 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.866452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38381 (local address 127.0.0.1:55024)
0809 22:50:45.868736 (+ 2284us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.868761 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.868978 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.870092 (+ 1114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.870099 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.870133 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:45.870734 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.870749 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.873305 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.873313 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.876839 (+ 3526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.876862 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.879970 (+ 3108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.879979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.880300 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.880378 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.881892 (+ 1514us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.882211 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2143,"thread_start_us":1996,"threads_started":1}
I20260809 22:50:45.884968 4737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.866309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58880 (local address 127.23.131.67:35493)
0809 22:50:45.867194 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.867233 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.867315 (+ 82us) server_negotiation.cc:407] Connection header received
0809 22:50:45.867704 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.867714 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.867979 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.868202 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:45.869496 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.874018 (+ 4522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.881601 (+ 7583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.883753 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.883959 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.884232 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.884474 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.884643 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":470,"threads_started":1}
I20260809 22:50:45.886739 4735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.865960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35493 (local address 127.0.0.1:58880)
0809 22:50:45.867142 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.867223 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.867439 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.868578 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.868591 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.868638 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:45.869214 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.869232 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.874302 (+ 5070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.874311 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.879489 (+ 5178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.879516 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.884033 (+ 4517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.884039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.884250 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.884290 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.884385 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.884548 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"mutex_wait_us":6,"thread_start_us":1084,"threads_started":1}
I20260809 22:50:45.887863 4356 tablet_service.cc:1467] Processing CreateTablet for tablet 872d5d7d47e9472d9bafb9bc8165afaf (DEFAULT_TABLE table=test-table [id=c2dae2e1cb90438ba9bb8505260770b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:45.889302 4356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 872d5d7d47e9472d9bafb9bc8165afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:45.890597 4591 tablet_service.cc:1467] Processing CreateTablet for tablet 872d5d7d47e9472d9bafb9bc8165afaf (DEFAULT_TABLE table=test-table [id=c2dae2e1cb90438ba9bb8505260770b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:45.892275 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.868849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45323 (local address 127.0.0.1:50464)
0809 22:50:45.883263 (+ 14414us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:45.883282 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:45.883441 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:45.884337 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:45.884342 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:45.884376 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:45.884570 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.884586 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.887329 (+ 2743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.887338 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.889122 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:45.889140 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.891099 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.891107 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:45.891484 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.891556 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 22:50:45.891681 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 22:50:45.891871 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14300,"thread_start_us":14697,"threads_started":1}
I20260809 22:50:45.892868 4748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:45.869249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50464 (local address 127.23.131.65:45323)
0809 22:50:45.882874 (+ 13625us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:45.882883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:45.883392 (+ 509us) server_negotiation.cc:407] Connection header received
0809 22:50:45.883653 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:45.883659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:45.883941 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:45.884176 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:45.884792 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.887132 (+ 2340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.889343 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:45.890880 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:45.891042 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:45.891286 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:45.892327 (+ 1041us) server_negotiation.cc:299] Negotiation successful
0809 22:50:45.892530 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13432,"thread_start_us":13321,"threads_started":1}
I20260809 22:50:45.892185 4591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 872d5d7d47e9472d9bafb9bc8165afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:45.897079 4122 tablet_service.cc:1467] Processing CreateTablet for tablet 872d5d7d47e9472d9bafb9bc8165afaf (DEFAULT_TABLE table=test-table [id=c2dae2e1cb90438ba9bb8505260770b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:45.898713 4122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 872d5d7d47e9472d9bafb9bc8165afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:45.902829 4749 tablet_bootstrap.cc:492] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Bootstrap starting.
I20260809 22:50:45.906064 4749 tablet_bootstrap.cc:654] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:45.907171 4749 log.cc:824] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:45.911079 4752 tablet_bootstrap.cc:492] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Bootstrap starting.
I20260809 22:50:45.914217 4749 tablet_bootstrap.cc:492] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: No bootstrap required, opened a new log
I20260809 22:50:45.914462 4753 tablet_bootstrap.cc:492] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Bootstrap starting.
I20260809 22:50:45.914534 4749 ts_tablet_manager.cc:1397] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260809 22:50:45.916267 4752 tablet_bootstrap.cc:654] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:45.917618 4752 log.cc:824] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:45.917771 4753 tablet_bootstrap.cc:654] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:45.919191 4753 log.cc:824] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:45.921833 4752 tablet_bootstrap.cc:492] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: No bootstrap required, opened a new log
I20260809 22:50:45.922139 4752 ts_tablet_manager.cc:1397] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260809 22:50:45.925525 4749 raft_consensus.cc:348] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:45.925989 4749 raft_consensus.cc:374] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:45.926134 4749 raft_consensus.cc:729] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0c5af6c0af4aef933eb25461e459e4, State: Initialized, Role: FOLLOWER
I20260809 22:50:45.926834 4749 consensus_queue.cc:260] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:45.928630 4753 tablet_bootstrap.cc:492] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: No bootstrap required, opened a new log
I20260809 22:50:45.929004 4753 ts_tablet_manager.cc:1397] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260809 22:50:45.929634 4476 heartbeater.cc:503] Master 127.23.131.126:36113 was elected leader, sending a full tablet report...
I20260809 22:50:45.930202 4749 ts_tablet_manager.cc:1428] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Time spent starting tablet: real 0.016s user 0.014s sys 0.002s
I20260809 22:50:45.933135 4752 raft_consensus.cc:348] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:45.933632 4752 raft_consensus.cc:374] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:45.933740 4752 raft_consensus.cc:729] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b67e4b0a84440d58debdfdce88d532b, State: Initialized, Role: FOLLOWER
I20260809 22:50:45.934420 4752 consensus_queue.cc:260] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:45.935698 4700 heartbeater.cc:503] Master 127.23.131.126:36113 was elected leader, sending a full tablet report...
I20260809 22:50:45.936520 4752 ts_tablet_manager.cc:1428] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
I20260809 22:50:45.939968 4753 raft_consensus.cc:348] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:45.940493 4753 raft_consensus.cc:374] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:45.940652 4753 raft_consensus.cc:729] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Initialized, Role: FOLLOWER
I20260809 22:50:45.941402 4753 consensus_queue.cc:260] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:45.943434 4753 ts_tablet_manager.cc:1428] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
W20260809 22:50:45.985204 4702 tablet.cc:2369] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:50:46.013361 4246 tablet.cc:2369] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:50:46.122641 4477 tablet.cc:2369] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:50:46.128011 4760 raft_consensus.cc:482] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:46.128386 4760 raft_consensus.cc:504] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:46.130086 4760 leader_election.cc:288] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493), ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381)
I20260809 22:50:46.138145 4737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.130636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53307 (local address 127.23.131.67:35493)
0809 22:50:46.130877 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.130888 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.131556 (+ 668us) server_negotiation.cc:407] Connection header received
0809 22:50:46.131733 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.131738 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.131812 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.131915 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:46.132786 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.133930 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.136237 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.137089 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.137217 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.137272 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.137713 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.137865 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 22:50:46.138255 4761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.130417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35493 (local address 127.23.131.65:53307)
0809 22:50:46.131350 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.131375 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.131583 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.131955 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.131960 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.132025 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:46.132584 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.132604 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.134102 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.134110 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.136083 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.136097 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.137304 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.137310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.137499 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.137565 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.137655 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.137757 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":105,"spinlock_wait_cycles":31360,"thread_start_us":495,"threads_started":1}
I20260809 22:50:46.138263 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.130555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:56235 (local address 127.23.131.66:38381)
0809 22:50:46.130798 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.130808 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.131503 (+ 695us) server_negotiation.cc:407] Connection header received
0809 22:50:46.131717 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.131723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.131803 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.131923 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:46.132786 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.133954 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.136281 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.137294 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.137464 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.137549 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.137855 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.138007 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 22:50:46.138406 4762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.130585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38381 (local address 127.23.131.65:56235)
0809 22:50:46.131374 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.131389 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.131549 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.131974 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.131977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.132037 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:46.132606 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.132629 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.134148 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.134152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.136084 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.136098 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.137513 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.137518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.137679 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.137711 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.137804 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.137928 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":157,"spinlock_wait_cycles":54528,"thread_start_us":399,"threads_started":1}
I20260809 22:50:46.139581 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "872d5d7d47e9472d9bafb9bc8165afaf" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b" is_pre_election: true
I20260809 22:50:46.139581 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "872d5d7d47e9472d9bafb9bc8165afaf" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4" is_pre_election: true
I20260809 22:50:46.140156 4381 raft_consensus.cc:2454] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 0.
I20260809 22:50:46.140172 4627 raft_consensus.cc:2454] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 0.
I20260809 22:50:46.140879 4044 leader_election.cc:302] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3b67e4b0a84440d58debdfdce88d532b, eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:46.141374 4760 raft_consensus.cc:2781] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:46.141530 4760 raft_consensus.cc:482] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:46.141664 4760 raft_consensus.cc:3037] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.144135 4760 raft_consensus.cc:504] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:46.144762 4760 leader_election.cc:288] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 election: Requested vote from peers 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493), ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381)
I20260809 22:50:46.145212 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "872d5d7d47e9472d9bafb9bc8165afaf" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b"
I20260809 22:50:46.145249 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "872d5d7d47e9472d9bafb9bc8165afaf" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4"
I20260809 22:50:46.145437 4627 raft_consensus.cc:3037] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.145454 4381 raft_consensus.cc:3037] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.147755 4627 raft_consensus.cc:2454] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 1.
I20260809 22:50:46.147778 4381 raft_consensus.cc:2454] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 1.
I20260809 22:50:46.148224 4042 leader_election.cc:302] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:46.148568 4760 raft_consensus.cc:2781] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:46.149045 4760 raft_consensus.cc:686] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 LEADER]: Becoming Leader. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Running, Role: LEADER
I20260809 22:50:46.149534 4760 consensus_queue.cc:237] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } }
I20260809 22:50:46.154321 3889 catalog_manager.cc:5495] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65). New cstate: current_term: 1 leader_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } health_report { overall_health: HEALTHY } } }
I20260809 22:50:46.179044 4748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.173475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50480 (local address 127.23.131.65:45323)
0809 22:50:46.173724 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.173731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.173842 (+ 111us) server_negotiation.cc:407] Connection header received
0809 22:50:46.174101 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.174106 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.174185 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.174345 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:46.174728 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.175520 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.176864 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.177279 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.177422 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.177892 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.178427 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.178592 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.178675 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.178763 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:50:46.187891 4381 raft_consensus.cc:1261] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Refusing update from remote peer eb3b46f0d70d42ed901c6cd0482ba81b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:46.187922 4627 raft_consensus.cc:1261] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Refusing update from remote peer eb3b46f0d70d42ed901c6cd0482ba81b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:46.189092 4764 consensus_queue.cc:1035] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:46.189473 4760 consensus_queue.cc:1035] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:46.203940 4771 mvcc.cc:205] Tried to move back new op lower bound from 7316749705974689792 to 7316749705832112128. Current Snapshot: MvccSnapshot[applied={T|T < 7316749705974689792}]
I20260809 22:50:46.205224 4772 mvcc.cc:205] Tried to move back new op lower bound from 7316749705974689792 to 7316749705832112128. Current Snapshot: MvccSnapshot[applied={T|T < 7316749705974689792}]
I20260809 22:50:46.216949 3887 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:46.217262 3887 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:46.221230 3887 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Sending DeleteTablet for 3 replicas of tablet 872d5d7d47e9472d9bafb9bc8165afaf
I20260809 22:50:46.222608 4591 tablet_service.cc:1514] Processing DeleteTablet for tablet 872d5d7d47e9472d9bafb9bc8165afaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:46 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58880
I20260809 22:50:46.222610 4356 tablet_service.cc:1514] Processing DeleteTablet for tablet 872d5d7d47e9472d9bafb9bc8165afaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:46 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55024
I20260809 22:50:46.222615 4122 tablet_service.cc:1514] Processing DeleteTablet for tablet 872d5d7d47e9472d9bafb9bc8165afaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:46 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:50464
I20260809 22:50:46.227154 3887 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:46.228533 3887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:46.239912 4786 tablet_replica.cc:330] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: stopping tablet replica
I20260809 22:50:46.241408 4121 tablet_service.cc:1467] Processing CreateTablet for tablet 599ad914d7414d7b924dcb1931a8b8be (DEFAULT_TABLE table=test-table [id=9f3118092ffe426cbeff4f8325dd8b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:46.241575 4786 raft_consensus.cc:2229] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:46.242161 4121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599ad914d7414d7b924dcb1931a8b8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:46.242198 4786 raft_consensus.cc:2258] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:46.243927 4587 tablet_service.cc:1467] Processing CreateTablet for tablet 599ad914d7414d7b924dcb1931a8b8be (DEFAULT_TABLE table=test-table [id=9f3118092ffe426cbeff4f8325dd8b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:46.244462 4587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599ad914d7414d7b924dcb1931a8b8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:46.244961 4783 tablet_replica.cc:330] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: stopping tablet replica
I20260809 22:50:46.245826 4783 raft_consensus.cc:2229] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:46.245949 4356 tablet_service.cc:1467] Processing CreateTablet for tablet 599ad914d7414d7b924dcb1931a8b8be (DEFAULT_TABLE table=test-table [id=9f3118092ffe426cbeff4f8325dd8b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:46.246410 4356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599ad914d7414d7b924dcb1931a8b8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:46.247321 4783 raft_consensus.cc:2258] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:46.248281 4784 tablet_replica.cc:330] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: stopping tablet replica
I20260809 22:50:46.249126 4784 raft_consensus.cc:2229] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:46.249740 4784 raft_consensus.cc:2258] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:46.251991 4784 ts_tablet_manager.cc:1905] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:46.254123 4786 ts_tablet_manager.cc:1905] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:46.257877 4752 tablet_bootstrap.cc:492] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Bootstrap starting.
I20260809 22:50:46.258927 4749 tablet_bootstrap.cc:492] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Bootstrap starting.
I20260809 22:50:46.259766 4753 tablet_bootstrap.cc:492] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Bootstrap starting.
I20260809 22:50:46.259775 4752 tablet_bootstrap.cc:654] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:46.260694 4749 tablet_bootstrap.cc:654] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:46.261853 4753 tablet_bootstrap.cc:654] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:46.266443 4784 ts_tablet_manager.cc:1918] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:46.269757 4783 ts_tablet_manager.cc:1905] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:46.270136 4784 log.cc:1196] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/872d5d7d47e9472d9bafb9bc8165afaf
I20260809 22:50:46.270951 4784 ts_tablet_manager.cc:1939] T 872d5d7d47e9472d9bafb9bc8165afaf P 3b67e4b0a84440d58debdfdce88d532b: Deleting consensus metadata
I20260809 22:50:46.271462 4753 tablet_bootstrap.cc:492] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: No bootstrap required, opened a new log
I20260809 22:50:46.271642 4753 ts_tablet_manager.cc:1397] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.002s
I20260809 22:50:46.271732 4752 tablet_bootstrap.cc:492] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: No bootstrap required, opened a new log
I20260809 22:50:46.271899 4752 ts_tablet_manager.cc:1397] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.007s
I20260809 22:50:46.272692 4753 raft_consensus.cc:348] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.272774 4752 raft_consensus.cc:348] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.273016 4752 raft_consensus.cc:374] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:46.272966 4753 raft_consensus.cc:374] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:46.273119 4752 raft_consensus.cc:729] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b67e4b0a84440d58debdfdce88d532b, State: Initialized, Role: FOLLOWER
I20260809 22:50:46.273140 4753 raft_consensus.cc:729] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Initialized, Role: FOLLOWER
I20260809 22:50:46.273447 4753 consensus_queue.cc:260] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.273419 4752 consensus_queue.cc:260] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.273847 3863 catalog_manager.cc:4841] TS 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493): tablet 872d5d7d47e9472d9bafb9bc8165afaf (table test-table [id=c2dae2e1cb90438ba9bb8505260770b5]) successfully deleted
I20260809 22:50:46.274107 4752 ts_tablet_manager.cc:1428] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 22:50:46.274107 4753 ts_tablet_manager.cc:1428] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 22:50:46.276692 4749 tablet_bootstrap.cc:492] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: No bootstrap required, opened a new log
I20260809 22:50:46.276942 4749 ts_tablet_manager.cc:1397] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.002s
I20260809 22:50:46.277959 4749 raft_consensus.cc:348] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.278215 4749 raft_consensus.cc:374] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:46.278319 4749 raft_consensus.cc:729] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0c5af6c0af4aef933eb25461e459e4, State: Initialized, Role: FOLLOWER
I20260809 22:50:46.278612 4749 consensus_queue.cc:260] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.279230 4749 ts_tablet_manager.cc:1428] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 22:50:46.279356 4786 ts_tablet_manager.cc:1918] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:46.279400 4783 ts_tablet_manager.cc:1918] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:46.279524 4786 log.cc:1196] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/872d5d7d47e9472d9bafb9bc8165afaf
I20260809 22:50:46.279637 4783 log.cc:1196] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/872d5d7d47e9472d9bafb9bc8165afaf
I20260809 22:50:46.280201 4786 ts_tablet_manager.cc:1939] T 872d5d7d47e9472d9bafb9bc8165afaf P ec0c5af6c0af4aef933eb25461e459e4: Deleting consensus metadata
I20260809 22:50:46.280242 4783 ts_tablet_manager.cc:1939] T 872d5d7d47e9472d9bafb9bc8165afaf P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting consensus metadata
I20260809 22:50:46.282233 3862 catalog_manager.cc:4841] TS ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381): tablet 872d5d7d47e9472d9bafb9bc8165afaf (table test-table [id=c2dae2e1cb90438ba9bb8505260770b5]) successfully deleted
I20260809 22:50:46.282521 3862 catalog_manager.cc:4841] TS eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323): tablet 872d5d7d47e9472d9bafb9bc8165afaf (table test-table [id=c2dae2e1cb90438ba9bb8505260770b5]) successfully deleted
I20260809 22:50:46.516461 4757 raft_consensus.cc:482] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:46.516721 4757 raft_consensus.cc:504] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.518567 4757 leader_election.cc:288] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323), ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381)
I20260809 22:50:46.527119 4748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.519421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:49805 (local address 127.23.131.65:45323)
0809 22:50:46.519614 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.519621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.519645 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:50:46.519737 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.519743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.519844 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.519951 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:46.520576 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.521763 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.524431 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.525770 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.525904 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.525997 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.526595 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.526758 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 22:50:46.527968 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.518892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45323 (local address 127.23.131.67:49805)
0809 22:50:46.519435 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.519455 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.519606 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.520004 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.520009 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.520037 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:46.520374 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.520384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.522000 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.522006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.524243 (+ 2237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.524261 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.526157 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.526164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.526400 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.526436 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.527421 (+ 985us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.527585 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":1193,"threads_started":1}
I20260809 22:50:46.531188 4153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599ad914d7414d7b924dcb1931a8b8be" candidate_uuid: "3b67e4b0a84440d58debdfdce88d532b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" is_pre_election: true
I20260809 22:50:46.531776 4153 raft_consensus.cc:2454] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b67e4b0a84440d58debdfdce88d532b in term 0.
I20260809 22:50:46.532523 4516 leader_election.cc:302] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b67e4b0a84440d58debdfdce88d532b, eb3b46f0d70d42ed901c6cd0482ba81b; no voters:
I20260809 22:50:46.533000 4757 raft_consensus.cc:2781] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:46.533160 4757 raft_consensus.cc:482] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:46.533290 4757 raft_consensus.cc:3037] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.535681 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.521076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:51135 (local address 127.23.131.66:38381)
0809 22:50:46.521271 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.521277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.528342 (+ 7065us) server_negotiation.cc:407] Connection header received
0809 22:50:46.528650 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.528656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.528737 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.528795 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:46.529352 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.530495 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.532899 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.534215 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.534370 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.534469 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.535167 (+ 698us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.535360 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 22:50:46.536126 4757 raft_consensus.cc:504] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.536638 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.520581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38381 (local address 127.23.131.67:51135)
0809 22:50:46.528232 (+ 7651us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.528253 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.528464 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.529008 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.529013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.529039 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:46.529198 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.529207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.530680 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.530687 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.532605 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.532643 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.534672 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.534678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.534913 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.534962 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.536079 (+ 1117us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.536294 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7528,"thread_start_us":9499,"threads_started":1}
I20260809 22:50:46.537050 4757 leader_election.cc:288] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [CANDIDATE]: Term 1 election: Requested vote from peers eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323), ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381)
I20260809 22:50:46.537817 4153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599ad914d7414d7b924dcb1931a8b8be" candidate_uuid: "3b67e4b0a84440d58debdfdce88d532b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b"
I20260809 22:50:46.537971 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599ad914d7414d7b924dcb1931a8b8be" candidate_uuid: "3b67e4b0a84440d58debdfdce88d532b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4" is_pre_election: true
I20260809 22:50:46.538116 4153 raft_consensus.cc:3037] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.538019 4380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599ad914d7414d7b924dcb1931a8b8be" candidate_uuid: "3b67e4b0a84440d58debdfdce88d532b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4"
I20260809 22:50:46.538304 4381 raft_consensus.cc:2454] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b67e4b0a84440d58debdfdce88d532b in term 0.
I20260809 22:50:46.541397 4153 raft_consensus.cc:2454] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b67e4b0a84440d58debdfdce88d532b in term 1.
I20260809 22:50:46.542021 4516 leader_election.cc:302] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b67e4b0a84440d58debdfdce88d532b, eb3b46f0d70d42ed901c6cd0482ba81b; no voters: ec0c5af6c0af4aef933eb25461e459e4
I20260809 22:50:46.542443 4757 raft_consensus.cc:2781] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:46.543100 4757 raft_consensus.cc:686] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 1 LEADER]: Becoming Leader. State: Replica: 3b67e4b0a84440d58debdfdce88d532b, State: Running, Role: LEADER
I20260809 22:50:46.543608 4757 consensus_queue.cc:237] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.547724 3887 catalog_manager.cc:5495] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67). New cstate: current_term: 1 leader_uuid: "3b67e4b0a84440d58debdfdce88d532b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } health_report { overall_health: HEALTHY } } }
Aug 09 22:50:46 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315843, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.126@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:46.669847 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.654253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36113 (local address 127.0.0.1:44654)
0809 22:50:46.655668 (+ 1415us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.655693 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.655904 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.656282 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.656286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.657138 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:46.657397 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.657408 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.658590 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.658596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.659717 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.659730 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.660508 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.660514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.660738 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.661524 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:46.661544 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:46.664079 (+ 2535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:46.667170 (+ 3091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:46.667184 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:46.667191 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:46.667680 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:46.668058 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:46.668063 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:46.668067 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:46.668203 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:46.668711 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:46.668720 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:46.668909 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.669075 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.669378 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":1103,"threads_started":1}
I20260809 22:50:46.669869 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.654296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44654 (local address 127.23.131.126:36113)
0809 22:50:46.655181 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.655185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.655783 (+ 598us) server_negotiation.cc:407] Connection header received
0809 22:50:46.656037 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.656044 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.656128 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.656254 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:46.657573 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.658430 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.659868 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.660316 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.660485 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.664302 (+ 3817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:46.664307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:46.664310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:46.664337 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:46.667038 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:46.667806 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:46.667816 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:46.667819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:46.667947 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:46.668316 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:46.668324 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:46.668328 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:46.668576 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:46.668752 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.669167 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.669512 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":134,"server-negotiator.queue_time_us":746,"thread_start_us":419,"threads_started":1}
I20260809 22:50:46.676147 3887 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:44654:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 22:50:46.677336 3887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:46.685202 4121 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6bc08bd9714baf9c1150c159a63652 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9de7c9b72f244330866ddbed990be0c5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:50:46.685236 4356 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6bc08bd9714baf9c1150c159a63652 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9de7c9b72f244330866ddbed990be0c5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:50:46.685563 4587 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6bc08bd9714baf9c1150c159a63652 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9de7c9b72f244330866ddbed990be0c5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 22:50:46.685827 4121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6bc08bd9714baf9c1150c159a63652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:46.685832 4356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6bc08bd9714baf9c1150c159a63652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:46.686084 4587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6bc08bd9714baf9c1150c159a63652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:46.692118 4749 tablet_bootstrap.cc:492] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: Bootstrap starting.
I20260809 22:50:46.693280 4753 tablet_bootstrap.cc:492] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: Bootstrap starting.
I20260809 22:50:46.693900 4752 tablet_bootstrap.cc:492] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: Bootstrap starting.
I20260809 22:50:46.694027 4749 tablet_bootstrap.cc:654] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:46.695359 4753 tablet_bootstrap.cc:654] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:46.695778 4752 tablet_bootstrap.cc:654] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:46.697965 4753 tablet_bootstrap.cc:492] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: No bootstrap required, opened a new log
I20260809 22:50:46.698165 4753 ts_tablet_manager.cc:1397] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260809 22:50:46.698299 4752 tablet_bootstrap.cc:492] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: No bootstrap required, opened a new log
I20260809 22:50:46.698488 4752 ts_tablet_manager.cc:1397] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 22:50:46.699092 4749 tablet_bootstrap.cc:492] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: No bootstrap required, opened a new log
I20260809 22:50:46.699008 4753 raft_consensus.cc:348] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.699280 4749 ts_tablet_manager.cc:1397] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260809 22:50:46.699326 4753 raft_consensus.cc:374] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:46.699404 4753 raft_consensus.cc:729] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Initialized, Role: FOLLOWER
I20260809 22:50:46.699295 4752 raft_consensus.cc:348] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.699571 4752 raft_consensus.cc:374] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:46.699690 4752 raft_consensus.cc:729] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b67e4b0a84440d58debdfdce88d532b, State: Initialized, Role: FOLLOWER
I20260809 22:50:46.699677 4753 consensus_queue.cc:260] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.699947 4752 consensus_queue.cc:260] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.700263 4753 ts_tablet_manager.cc:1428] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 22:50:46.700146 4749 raft_consensus.cc:348] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.700397 4749 raft_consensus.cc:374] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:46.700485 4749 raft_consensus.cc:729] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0c5af6c0af4aef933eb25461e459e4, State: Initialized, Role: FOLLOWER
I20260809 22:50:46.700378 4764 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.700371 4757 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.700695 4757 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.700695 4764 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.700802 4749 consensus_queue.cc:260] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.701160 4752 ts_tablet_manager.cc:1428] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:46.701378 4749 ts_tablet_manager.cc:1428] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 22:50:46.701256 4756 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.701660 4756 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.711143 4756 raft_consensus.cc:482] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:46.711447 4756 raft_consensus.cc:504] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.713248 4756 leader_election.cc:288] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323), 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:46.721627 4748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.713712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:38791 (local address 127.23.131.65:45323)
0809 22:50:46.714130 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.714142 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.714866 (+ 724us) server_negotiation.cc:407] Connection header received
0809 22:50:46.715102 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.715115 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.715181 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.715329 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:46.716028 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.717037 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.719352 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.720567 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.720734 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.720809 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.721174 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.721336 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204}
I20260809 22:50:46.721658 4812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.713612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45323 (local address 127.23.131.66:38791)
0809 22:50:46.714747 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.714763 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.714939 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.715358 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.715363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.715393 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:46.715808 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.715823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.717183 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.717191 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.719089 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.719102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.720809 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.720814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.720989 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.721027 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.721115 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.721222 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"mutex_wait_us":36,"thread_start_us":499,"threads_started":1}
I20260809 22:50:46.722306 4153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6bc08bd9714baf9c1150c159a63652" candidate_uuid: "ec0c5af6c0af4aef933eb25461e459e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" is_pre_election: true
I20260809 22:50:46.722481 4813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.713612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35493 (local address 127.23.131.66:43931)
0809 22:50:46.714225 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.714253 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.714426 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.716209 (+ 1783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.716214 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.716240 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:50:46.716613 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.716625 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.718187 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.718195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.720016 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.720031 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.721627 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.721635 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.721835 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.721883 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.721970 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.722135 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":868,"threads_started":1}
I20260809 22:50:46.722461 4814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.713819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:43931 (local address 127.23.131.67:35493)
0809 22:50:46.715872 (+ 2053us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.715880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.715904 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:50:46.715990 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.715996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.716075 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.716162 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:50:46.716827 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.718030 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.720225 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.721359 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.721540 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.721615 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.722126 (+ 511us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.722260 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1917,"thread_start_us":1797,"threads_started":1}
I20260809 22:50:46.722636 4153 raft_consensus.cc:2454] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec0c5af6c0af4aef933eb25461e459e4 in term 0.
I20260809 22:50:46.723193 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6bc08bd9714baf9c1150c159a63652" candidate_uuid: "ec0c5af6c0af4aef933eb25461e459e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b" is_pre_election: true
I20260809 22:50:46.723192 4277 leader_election.cc:302] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:46.723500 4627 raft_consensus.cc:2454] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec0c5af6c0af4aef933eb25461e459e4 in term 0.
I20260809 22:50:46.723712 4756 raft_consensus.cc:2781] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:46.723872 4756 raft_consensus.cc:482] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:46.724011 4756 raft_consensus.cc:3037] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.726198 4756 raft_consensus.cc:504] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.726765 4756 leader_election.cc:288] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [CANDIDATE]: Term 1 election: Requested vote from peers eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323), 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:46.727463 4153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6bc08bd9714baf9c1150c159a63652" candidate_uuid: "ec0c5af6c0af4aef933eb25461e459e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b"
I20260809 22:50:46.727470 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6bc08bd9714baf9c1150c159a63652" candidate_uuid: "ec0c5af6c0af4aef933eb25461e459e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b"
I20260809 22:50:46.727720 4153 raft_consensus.cc:3037] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.727715 4627 raft_consensus.cc:3037] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.730116 4153 raft_consensus.cc:2454] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec0c5af6c0af4aef933eb25461e459e4 in term 1.
I20260809 22:50:46.730238 4627 raft_consensus.cc:2454] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec0c5af6c0af4aef933eb25461e459e4 in term 1.
I20260809 22:50:46.730607 4277 leader_election.cc:302] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:46.730950 4756 raft_consensus.cc:2781] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:46.731662 4756 raft_consensus.cc:686] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [term 1 LEADER]: Becoming Leader. State: Replica: ec0c5af6c0af4aef933eb25461e459e4, State: Running, Role: LEADER
I20260809 22:50:46.732172 4756 consensus_queue.cc:237] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:46.734756 4815 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: TxnStatusTablet state changed. Reason: New leader ec0c5af6c0af4aef933eb25461e459e4. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.735263 4815 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:50:46.736075 4820 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 22:50:46.736291 4820 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 22:50:46.736734 3886 catalog_manager.cc:5495] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66). New cstate: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } health_report { overall_health: UNKNOWN } } }
I20260809 22:50:46.759500 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.750982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38381 (local address 127.0.0.1:55030)
0809 22:50:46.751570 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.751591 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.751746 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.752553 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.752558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.752573 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:50:46.752785 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.752797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.754404 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.754410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.756247 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.756263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.757446 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.757473 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.757733 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.757823 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.758956 (+ 1133us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.758975 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.759051 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.759183 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260809 22:50:46.759563 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.751006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55030 (local address 127.23.131.66:38381)
0809 22:50:46.751414 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.751422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.751934 (+ 512us) server_negotiation.cc:407] Connection header received
0809 22:50:46.752049 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.752055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.752201 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.752337 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:46.752966 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.754203 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.756440 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.757192 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.757322 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.758034 (+ 712us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.758836 (+ 802us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.758992 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.759080 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.759184 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236}
I20260809 22:50:46.765264 4627 raft_consensus.cc:1261] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Refusing update from remote peer ec0c5af6c0af4aef933eb25461e459e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:46.765564 4153 raft_consensus.cc:1261] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Refusing update from remote peer ec0c5af6c0af4aef933eb25461e459e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:46.766202 4815 consensus_queue.cc:1035] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:46.766582 4756 consensus_queue.cc:1035] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:46.772926 4764 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: TxnStatusTablet state changed. Reason: New leader ec0c5af6c0af4aef933eb25461e459e4. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.773267 4764 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.785692 4764 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.786046 4764 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P eb3b46f0d70d42ed901c6cd0482ba81b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.786398 4815 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.786746 4815 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:50:46.786837 4757 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: TxnStatusTablet state changed. Reason: New leader ec0c5af6c0af4aef933eb25461e459e4. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.787153 4757 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.788957 4815 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.789292 4815 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P ec0c5af6c0af4aef933eb25461e459e4: This TxnStatusTablet replica's current role is: LEADER
I20260809 22:50:46.793476 4757 tablet_replica.cc:439] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ec0c5af6c0af4aef933eb25461e459e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } } }
I20260809 22:50:46.793828 4757 tablet_replica.cc:442] T 1c6bc08bd9714baf9c1150c159a63652 P 3b67e4b0a84440d58debdfdce88d532b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 22:50:46.806278 4814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.798590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58886 (local address 127.23.131.67:35493)
0809 22:50:46.798816 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.798824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.799084 (+ 260us) server_negotiation.cc:407] Connection header received
0809 22:50:46.799386 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.799395 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.799543 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.799688 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:46.800262 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.801141 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.803249 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.804071 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.804200 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.804762 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.805546 (+ 784us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.805715 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.805839 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.805940 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 22:50:46.829847 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.819070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38381 (local address 127.23.131.67:53161)
0809 22:50:46.823458 (+ 4388us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.823477 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.823684 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.824152 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.824158 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.824173 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:50:46.824570 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.824580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.826146 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.826150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.827392 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.827407 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.828523 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.828528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.828728 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.828795 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.829286 (+ 491us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.829297 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.829387 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.829519 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4210,"thread_start_us":3948,"threads_started":1}
I20260809 22:50:46.829866 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.819098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:53161 (local address 127.23.131.66:38381)
0809 22:50:46.819343 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.819350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.823599 (+ 4249us) server_negotiation.cc:407] Connection header received
0809 22:50:46.823871 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.823877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.823998 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.824160 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:46.824792 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.825993 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.827550 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.828322 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.828449 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.829023 (+ 574us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.829173 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.829276 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.829437 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.829538 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 22:50:46.842032 4381 raft_consensus.cc:3037] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:46.842201 4153 raft_consensus.cc:1261] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Refusing update from remote peer 3b67e4b0a84440d58debdfdce88d532b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:46.842859 4793 consensus_queue.cc:1035] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:46.845257 4381 raft_consensus.cc:1261] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Refusing update from remote peer 3b67e4b0a84440d58debdfdce88d532b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:46.846935 4757 consensus_queue.cc:1035] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:46.902030 4814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.894509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:40467 (local address 127.23.131.67:35493)
0809 22:50:46.894740 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:46.894750 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:46.895504 (+ 754us) server_negotiation.cc:407] Connection header received
0809 22:50:46.895680 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:46.895686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:46.895787 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:46.895888 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:46.896486 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.897508 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.899850 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.900364 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.900468 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.901096 (+ 628us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.901216 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.901330 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:46.901538 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 22:50:46.901644 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:50:46.902117 4855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:46.894563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35493 (local address 127.23.131.66:40467)
0809 22:50:46.895381 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:46.895398 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:46.895525 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:46.895911 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:46.895916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:46.895928 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:50:46.896306 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.896315 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.897657 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.897664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.899689 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:46.899708 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:46.900579 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:46.900587 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:46.900801 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:46.900905 (+ 104us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:50:46.901381 (+ 476us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:50:46.901395 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 22:50:46.901463 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 22:50:46.901656 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":384,"threads_started":1}
I20260809 22:50:46.953588 3886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:46.953946 3886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:46.958384 3886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Sending DeleteTablet for 3 replicas of tablet 599ad914d7414d7b924dcb1931a8b8be
I20260809 22:50:46.959550 4121 tablet_service.cc:1514] Processing DeleteTablet for tablet 599ad914d7414d7b924dcb1931a8b8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:46 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:50464
I20260809 22:50:46.959581 4356 tablet_service.cc:1514] Processing DeleteTablet for tablet 599ad914d7414d7b924dcb1931a8b8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:46 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55024
I20260809 22:50:46.960418 4587 tablet_service.cc:1514] Processing DeleteTablet for tablet 599ad914d7414d7b924dcb1931a8b8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:46 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58880
I20260809 22:50:46.986868 4862 tablet_replica.cc:330] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: stopping tablet replica
I20260809 22:50:46.987843 4859 tablet_replica.cc:330] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: stopping tablet replica
I20260809 22:50:46.988094 4859 raft_consensus.cc:2229] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:46.988507 4859 raft_consensus.cc:2258] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:46.988754 4862 raft_consensus.cc:2229] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:46.989490 4862 raft_consensus.cc:2258] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:46.989804 4858 tablet_replica.cc:330] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: stopping tablet replica
I20260809 22:50:46.990079 4858 raft_consensus.cc:2229] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:46.990375 4858 raft_consensus.cc:2258] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:46.990932 4862 ts_tablet_manager.cc:1905] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:46.991753 4858 ts_tablet_manager.cc:1905] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:46.992408 4859 ts_tablet_manager.cc:1905] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.000099 4858 ts_tablet_manager.cc:1918] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:50:47.002365 4858 log.cc:1196] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/599ad914d7414d7b924dcb1931a8b8be
I20260809 22:50:47.003046 4858 ts_tablet_manager.cc:1939] T 599ad914d7414d7b924dcb1931a8b8be P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting consensus metadata
I20260809 22:50:47.004508 3862 catalog_manager.cc:4841] TS eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323): tablet 599ad914d7414d7b924dcb1931a8b8be (table test-table [id=9f3118092ffe426cbeff4f8325dd8b31]) successfully deleted
I20260809 22:50:47.006560 4859 ts_tablet_manager.cc:1918] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:50:47.006747 4859 log.cc:1196] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/599ad914d7414d7b924dcb1931a8b8be
I20260809 22:50:47.007357 4859 ts_tablet_manager.cc:1939] T 599ad914d7414d7b924dcb1931a8b8be P ec0c5af6c0af4aef933eb25461e459e4: Deleting consensus metadata
I20260809 22:50:47.008911 3862 catalog_manager.cc:4841] TS ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381): tablet 599ad914d7414d7b924dcb1931a8b8be (table test-table [id=9f3118092ffe426cbeff4f8325dd8b31]) successfully deleted
I20260809 22:50:47.011775 4862 ts_tablet_manager.cc:1918] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:50:47.011965 4862 log.cc:1196] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/599ad914d7414d7b924dcb1931a8b8be
I20260809 22:50:47.012548 4862 ts_tablet_manager.cc:1939] T 599ad914d7414d7b924dcb1931a8b8be P 3b67e4b0a84440d58debdfdce88d532b: Deleting consensus metadata
I20260809 22:50:47.014125 3863 catalog_manager.cc:4841] TS 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493): tablet 599ad914d7414d7b924dcb1931a8b8be (table test-table [id=9f3118092ffe426cbeff4f8325dd8b31]) successfully deleted
Aug 09 22:50:47 dist-test-slave-92m1 krb5kdc[3814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 22:50:47 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:47 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 22:50:47.076864 4804 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:47.062687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44668 (local address 127.23.131.126:36113)
0809 22:50:47.062891 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.062909 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.063480 (+ 571us) server_negotiation.cc:407] Connection header received
0809 22:50:47.063696 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.063702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.063809 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.063947 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:47.065822 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.066987 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.068915 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.069646 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.069798 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.076544 (+ 6746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44668: BlockingRecv error: recv got EOF from 127.0.0.1:44668 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 22:50:47 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM
I20260809 22:50:47.102417 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.080979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44684 (local address 127.23.131.126:36113)
0809 22:50:47.081161 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.081168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.081636 (+ 468us) server_negotiation.cc:407] Connection header received
0809 22:50:47.081818 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.081826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.081927 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.082054 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:47.083714 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.084898 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.086969 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.087693 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.087836 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.093665 (+ 5829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:47.093674 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:47.093680 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:47.093737 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:47.097831 (+ 4094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:47.098871 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:47.098878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:47.098882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:47.099189 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:47.099918 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:47.099925 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:47.099929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:47.100384 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:47.100763 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:47.101767 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0809 22:50:47.102031 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:50:47.107358 3886 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:47.108191 3886 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:47.117017 4121 tablet_service.cc:1467] Processing CreateTablet for tablet 11738ca80bc24c1eaabe2c7417e2ba8b (DEFAULT_TABLE table=test-table [id=c640225cccb747bda070210d09ea6048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:47.117384 4587 tablet_service.cc:1467] Processing CreateTablet for tablet 11738ca80bc24c1eaabe2c7417e2ba8b (DEFAULT_TABLE table=test-table [id=c640225cccb747bda070210d09ea6048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:47.117627 4121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11738ca80bc24c1eaabe2c7417e2ba8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:47.117672 4356 tablet_service.cc:1467] Processing CreateTablet for tablet 11738ca80bc24c1eaabe2c7417e2ba8b (DEFAULT_TABLE table=test-table [id=c640225cccb747bda070210d09ea6048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:47.117843 4587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11738ca80bc24c1eaabe2c7417e2ba8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:47.118175 4356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11738ca80bc24c1eaabe2c7417e2ba8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:47.124605 4752 tablet_bootstrap.cc:492] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Bootstrap starting.
I20260809 22:50:47.126497 4752 tablet_bootstrap.cc:654] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:47.127481 4753 tablet_bootstrap.cc:492] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Bootstrap starting.
I20260809 22:50:47.128975 4749 tablet_bootstrap.cc:492] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Bootstrap starting.
I20260809 22:50:47.129259 4753 tablet_bootstrap.cc:654] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:47.130870 4749 tablet_bootstrap.cc:654] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:47.145143 4753 tablet_bootstrap.cc:492] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: No bootstrap required, opened a new log
I20260809 22:50:47.145466 4753 ts_tablet_manager.cc:1397] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.006s
I20260809 22:50:47.146562 4753 raft_consensus.cc:348] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.147101 4753 raft_consensus.cc:374] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:47.147316 4753 raft_consensus.cc:729] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Initialized, Role: FOLLOWER
I20260809 22:50:47.148053 4749 tablet_bootstrap.cc:492] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: No bootstrap required, opened a new log
I20260809 22:50:47.147897 4753 consensus_queue.cc:260] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.148238 4749 ts_tablet_manager.cc:1397] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.007s
I20260809 22:50:47.149741 4753 ts_tablet_manager.cc:1428] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 22:50:47.150915 4752 tablet_bootstrap.cc:492] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: No bootstrap required, opened a new log
I20260809 22:50:47.151196 4752 ts_tablet_manager.cc:1397] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.001s
I20260809 22:50:47.152213 4752 raft_consensus.cc:348] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.152593 4752 raft_consensus.cc:374] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:47.152786 4752 raft_consensus.cc:729] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b67e4b0a84440d58debdfdce88d532b, State: Initialized, Role: FOLLOWER
I20260809 22:50:47.153169 4752 consensus_queue.cc:260] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.153949 4752 ts_tablet_manager.cc:1428] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 22:50:47.159674 4749 raft_consensus.cc:348] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.160030 4749 raft_consensus.cc:374] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:47.160144 4749 raft_consensus.cc:729] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0c5af6c0af4aef933eb25461e459e4, State: Initialized, Role: FOLLOWER
I20260809 22:50:47.160436 4749 consensus_queue.cc:260] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.161859 4749 ts_tablet_manager.cc:1428] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260809 22:50:47.318583 4764 raft_consensus.cc:482] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:47.318907 4764 raft_consensus.cc:504] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.319708 4764 leader_election.cc:288] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381), 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:47.320468 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11738ca80bc24c1eaabe2c7417e2ba8b" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4" is_pre_election: true
I20260809 22:50:47.320478 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11738ca80bc24c1eaabe2c7417e2ba8b" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b" is_pre_election: true
I20260809 22:50:47.320765 4381 raft_consensus.cc:2454] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 0.
I20260809 22:50:47.320771 4627 raft_consensus.cc:2454] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 0.
I20260809 22:50:47.321324 4044 leader_election.cc:302] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b67e4b0a84440d58debdfdce88d532b, eb3b46f0d70d42ed901c6cd0482ba81b; no voters:
I20260809 22:50:47.321678 4764 raft_consensus.cc:2781] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:47.321799 4764 raft_consensus.cc:482] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:47.321919 4764 raft_consensus.cc:3037] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:47.325243 4764 raft_consensus.cc:504] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.326045 4764 leader_election.cc:288] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 election: Requested vote from peers ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381), 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:47.326663 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11738ca80bc24c1eaabe2c7417e2ba8b" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4"
I20260809 22:50:47.326682 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11738ca80bc24c1eaabe2c7417e2ba8b" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b"
I20260809 22:50:47.326910 4381 raft_consensus.cc:3037] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:47.326946 4627 raft_consensus.cc:3037] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:47.329291 4381 raft_consensus.cc:2454] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 1.
I20260809 22:50:47.329799 4042 leader_election.cc:302] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:47.330099 4764 raft_consensus.cc:2781] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:47.330539 4627 raft_consensus.cc:2454] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 1.
I20260809 22:50:47.330639 4764 raft_consensus.cc:686] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 LEADER]: Becoming Leader. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Running, Role: LEADER
I20260809 22:50:47.331032 4764 consensus_queue.cc:237] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.334964 3887 catalog_manager.cc:5495] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65). New cstate: current_term: 1 leader_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } health_report { overall_health: UNKNOWN } } }
I20260809 22:50:47.391812 4894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.386342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50488 (local address 127.23.131.65:45323)
0809 22:50:47.386958 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.386962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.386978 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:50:47.387039 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.387042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.387107 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.387250 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:47.387663 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.388497 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.389924 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.390375 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.390521 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.390991 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:47.391103 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:47.391207 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:47.391391 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 22:50:47.391479 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":310,"threads_started":1}
I20260809 22:50:47.395058 4627 raft_consensus.cc:1261] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Refusing update from remote peer eb3b46f0d70d42ed901c6cd0482ba81b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:47.395143 4381 raft_consensus.cc:1261] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Refusing update from remote peer eb3b46f0d70d42ed901c6cd0482ba81b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:47.395954 4891 consensus_queue.cc:1035] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:47.396431 4764 consensus_queue.cc:1035] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:47.418388 3886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:47.418687 3886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:47.422163 3886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Sending DeleteTablet for 3 replicas of tablet 11738ca80bc24c1eaabe2c7417e2ba8b
I20260809 22:50:47.423070 4121 tablet_service.cc:1514] Processing DeleteTablet for tablet 11738ca80bc24c1eaabe2c7417e2ba8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:47 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:50464
I20260809 22:50:47.423174 4356 tablet_service.cc:1514] Processing DeleteTablet for tablet 11738ca80bc24c1eaabe2c7417e2ba8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:47 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55024
I20260809 22:50:47.423454 4858 tablet_replica.cc:330] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: stopping tablet replica
I20260809 22:50:47.423614 4587 tablet_service.cc:1514] Processing DeleteTablet for tablet 11738ca80bc24c1eaabe2c7417e2ba8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:47 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58880
I20260809 22:50:47.423681 4858 raft_consensus.cc:2229] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:47.423950 4859 tablet_replica.cc:330] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: stopping tablet replica
I20260809 22:50:47.424018 4858 raft_consensus.cc:2258] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:47.424166 4859 raft_consensus.cc:2229] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:47.424413 4859 raft_consensus.cc:2258] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:47.424736 4862 tablet_replica.cc:330] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: stopping tablet replica
I20260809 22:50:47.424945 4862 raft_consensus.cc:2229] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:47.425203 4862 raft_consensus.cc:2258] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:47.425220 4858 ts_tablet_manager.cc:1905] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.426426 4859 ts_tablet_manager.cc:1905] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.427456 3886 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:50:47.428467 3886 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:50:47.433182 4858 ts_tablet_manager.cc:1918] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:47.433362 4858 log.cc:1196] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/11738ca80bc24c1eaabe2c7417e2ba8b
I20260809 22:50:47.433845 4858 ts_tablet_manager.cc:1939] T 11738ca80bc24c1eaabe2c7417e2ba8b P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting consensus metadata
I20260809 22:50:47.435312 3862 catalog_manager.cc:4841] TS eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323): tablet 11738ca80bc24c1eaabe2c7417e2ba8b (table test-table [id=c640225cccb747bda070210d09ea6048]) successfully deleted
I20260809 22:50:47.436729 4121 tablet_service.cc:1467] Processing CreateTablet for tablet 887294263dd2415d99e1067b62577bee (DEFAULT_TABLE table=test-table [id=cfa0ad8817c54ba7b42fcf3d509ab23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:47.437179 4121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887294263dd2415d99e1067b62577bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:47.437392 4356 tablet_service.cc:1467] Processing CreateTablet for tablet 887294263dd2415d99e1067b62577bee (DEFAULT_TABLE table=test-table [id=cfa0ad8817c54ba7b42fcf3d509ab23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:47.437796 4859 ts_tablet_manager.cc:1918] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:47.437887 4356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887294263dd2415d99e1067b62577bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:47.437958 4859 log.cc:1196] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/11738ca80bc24c1eaabe2c7417e2ba8b
I20260809 22:50:47.438476 4859 ts_tablet_manager.cc:1939] T 11738ca80bc24c1eaabe2c7417e2ba8b P ec0c5af6c0af4aef933eb25461e459e4: Deleting consensus metadata
I20260809 22:50:47.440330 4862 ts_tablet_manager.cc:1905] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.441335 4587 tablet_service.cc:1467] Processing CreateTablet for tablet 887294263dd2415d99e1067b62577bee (DEFAULT_TABLE table=test-table [id=cfa0ad8817c54ba7b42fcf3d509ab23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:50:47.441800 4587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887294263dd2415d99e1067b62577bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:47.442369 3862 catalog_manager.cc:4841] TS ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381): tablet 11738ca80bc24c1eaabe2c7417e2ba8b (table test-table [id=c640225cccb747bda070210d09ea6048]) successfully deleted
I20260809 22:50:47.445992 4753 tablet_bootstrap.cc:492] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Bootstrap starting.
I20260809 22:50:47.446813 4749 tablet_bootstrap.cc:492] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Bootstrap starting.
I20260809 22:50:47.447852 4753 tablet_bootstrap.cc:654] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:47.447921 4862 ts_tablet_manager.cc:1918] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:50:47.448112 4862 log.cc:1196] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/11738ca80bc24c1eaabe2c7417e2ba8b
I20260809 22:50:47.448571 4862 ts_tablet_manager.cc:1939] T 11738ca80bc24c1eaabe2c7417e2ba8b P 3b67e4b0a84440d58debdfdce88d532b: Deleting consensus metadata
I20260809 22:50:47.448637 4749 tablet_bootstrap.cc:654] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:47.449524 4752 tablet_bootstrap.cc:492] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Bootstrap starting.
I20260809 22:50:47.451236 4752 tablet_bootstrap.cc:654] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:47.452561 3863 catalog_manager.cc:4841] TS 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493): tablet 11738ca80bc24c1eaabe2c7417e2ba8b (table test-table [id=c640225cccb747bda070210d09ea6048]) successfully deleted
I20260809 22:50:47.458297 4753 tablet_bootstrap.cc:492] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: No bootstrap required, opened a new log
I20260809 22:50:47.458571 4753 ts_tablet_manager.cc:1397] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260809 22:50:47.458979 4752 tablet_bootstrap.cc:492] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: No bootstrap required, opened a new log
I20260809 22:50:47.459251 4752 ts_tablet_manager.cc:1397] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260809 22:50:47.459725 4753 raft_consensus.cc:348] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.460022 4753 raft_consensus.cc:374] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:47.460130 4753 raft_consensus.cc:729] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Initialized, Role: FOLLOWER
I20260809 22:50:47.460465 4753 consensus_queue.cc:260] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.461000 4749 tablet_bootstrap.cc:492] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: No bootstrap required, opened a new log
I20260809 22:50:47.461196 4749 ts_tablet_manager.cc:1397] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260809 22:50:47.461256 4753 ts_tablet_manager.cc:1428] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:47.460369 4752 raft_consensus.cc:348] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.462114 4752 raft_consensus.cc:374] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:47.462064 4749 raft_consensus.cc:348] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.462330 4749 raft_consensus.cc:374] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:47.462416 4749 raft_consensus.cc:729] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0c5af6c0af4aef933eb25461e459e4, State: Initialized, Role: FOLLOWER
I20260809 22:50:47.462255 4752 raft_consensus.cc:729] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b67e4b0a84440d58debdfdce88d532b, State: Initialized, Role: FOLLOWER
I20260809 22:50:47.462718 4749 consensus_queue.cc:260] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.462771 4752 consensus_queue.cc:260] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.464839 4752 ts_tablet_manager.cc:1428] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260809 22:50:47.466594 4749 ts_tablet_manager.cc:1428] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260809 22:50:47.513751 4764 raft_consensus.cc:482] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:50:47.514046 4764 raft_consensus.cc:504] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.514787 4764 leader_election.cc:288] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381), 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:47.515473 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887294263dd2415d99e1067b62577bee" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4" is_pre_election: true
I20260809 22:50:47.515568 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887294263dd2415d99e1067b62577bee" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b" is_pre_election: true
I20260809 22:50:47.515772 4381 raft_consensus.cc:2454] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 0.
I20260809 22:50:47.515838 4627 raft_consensus.cc:2454] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 0.
I20260809 22:50:47.516305 4042 leader_election.cc:302] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:47.516630 4764 raft_consensus.cc:2781] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:50:47.516717 4764 raft_consensus.cc:482] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:50:47.516819 4764 raft_consensus.cc:3037] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:47.520023 4764 raft_consensus.cc:504] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.520684 4764 leader_election.cc:288] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 election: Requested vote from peers ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381), 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493)
I20260809 22:50:47.521234 4381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887294263dd2415d99e1067b62577bee" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec0c5af6c0af4aef933eb25461e459e4"
I20260809 22:50:47.521234 4627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887294263dd2415d99e1067b62577bee" candidate_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b67e4b0a84440d58debdfdce88d532b"
I20260809 22:50:47.521466 4627 raft_consensus.cc:3037] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:47.521471 4381 raft_consensus.cc:3037] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:47.523756 4381 raft_consensus.cc:2454] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 1.
I20260809 22:50:47.524309 4042 leader_election.cc:302] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb3b46f0d70d42ed901c6cd0482ba81b, ec0c5af6c0af4aef933eb25461e459e4; no voters:
I20260809 22:50:47.524617 4764 raft_consensus.cc:2781] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:47.524621 4627 raft_consensus.cc:2454] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb3b46f0d70d42ed901c6cd0482ba81b in term 1.
I20260809 22:50:47.525031 4764 raft_consensus.cc:686] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 LEADER]: Becoming Leader. State: Replica: eb3b46f0d70d42ed901c6cd0482ba81b, State: Running, Role: LEADER
I20260809 22:50:47.525354 4764 consensus_queue.cc:237] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } }
I20260809 22:50:47.528215 3884 catalog_manager.cc:5495] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b reported cstate change: term changed from 0 to 1, leader changed from <none> to eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65). New cstate: current_term: 1 leader_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb3b46f0d70d42ed901c6cd0482ba81b" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 } health_report { overall_health: UNKNOWN } } }
I20260809 22:50:47.568646 4916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.562695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:57195 (local address 127.23.131.66:38381)
0809 22:50:47.563323 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.563330 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.563531 (+ 201us) server_negotiation.cc:407] Connection header received
0809 22:50:47.563783 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.563789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.563858 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.563977 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:47.564504 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.565222 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.566674 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.567120 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.567307 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.567777 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:47.567905 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:47.568016 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:47.568178 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 22:50:47.568267 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":304,"threads_started":1}
I20260809 22:50:47.568717 4917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.562621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:38381 (local address 127.23.131.65:57195)
0809 22:50:47.563420 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:47.563437 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:47.563622 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:47.564012 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:47.564017 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:47.564030 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:50:47.564327 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:47.564336 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.565399 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.565404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:47.566524 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:47.566536 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.567338 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.567345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:47.567500 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.567563 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:50:47.568034 (+ 471us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:50:47.568055 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 22:50:47.568149 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 22:50:47.568310 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":421,"threads_started":1}
I20260809 22:50:47.577729 4627 raft_consensus.cc:1261] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Refusing update from remote peer eb3b46f0d70d42ed901c6cd0482ba81b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:47.577731 4381 raft_consensus.cc:1261] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Refusing update from remote peer eb3b46f0d70d42ed901c6cd0482ba81b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:50:47.578356 4891 consensus_queue.cc:1035] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b67e4b0a84440d58debdfdce88d532b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:47.578678 4764 consensus_queue.cc:1035] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec0c5af6c0af4aef933eb25461e459e4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 38381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:50:47.585253 4851 mvcc.cc:205] Tried to move back new op lower bound from 7316749711673577472 to 7316749711466491904. Current Snapshot: MvccSnapshot[applied={T|T < 7316749711673577472}]
I20260809 22:50:47.605598 4894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.599684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:49497 (local address 127.23.131.65:45323)
0809 22:50:47.600032 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.600037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.600433 (+ 396us) server_negotiation.cc:407] Connection header received
0809 22:50:47.600564 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.600567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.600630 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.600700 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:50:47.601160 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.602184 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.604089 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.604487 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.604587 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.604920 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:50:47.605047 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:50:47.605121 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:47.605274 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 22:50:47.605355 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203}
I20260809 22:50:47.605758 4924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.599656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45323 (local address 127.23.131.66:49497)
0809 22:50:47.600338 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:47.600354 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:47.600469 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:47.600705 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:47.600708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:47.600716 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 22:50:47.600995 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:47.601008 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.602328 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.602333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:47.603929 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:47.603944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.604624 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.604628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:47.604751 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.604787 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 22:50:47.605142 (+ 355us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 22:50:47.605151 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 22:50:47.605222 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 22:50:47.605327 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":397,"threads_started":1}
I20260809 22:50:47.636273 3889 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:47.636572 3889 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:50:47.639704 3889 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e6f408a910499f8d2c6499196bec28: Sending DeleteTablet for 3 replicas of tablet 887294263dd2415d99e1067b62577bee
I20260809 22:50:47.640767 4587 tablet_service.cc:1514] Processing DeleteTablet for tablet 887294263dd2415d99e1067b62577bee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:47 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:58880
I20260809 22:50:47.641130 4862 tablet_replica.cc:330] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: stopping tablet replica
I20260809 22:50:47.641047 4356 tablet_service.cc:1514] Processing DeleteTablet for tablet 887294263dd2415d99e1067b62577bee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:47 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55024
I20260809 22:50:47.641053 4121 tablet_service.cc:1514] Processing DeleteTablet for tablet 887294263dd2415d99e1067b62577bee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:50:47 UTC) from {username='oryx', principal='oryx/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:50464
I20260809 22:50:47.641355 4862 raft_consensus.cc:2229] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:47.641425 4859 tablet_replica.cc:330] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: stopping tablet replica
I20260809 22:50:47.641438 4858 tablet_replica.cc:330] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: stopping tablet replica
I20260809 22:50:47.641618 4862 raft_consensus.cc:2258] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:47.641659 4858 raft_consensus.cc:2229] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:50:47.641659 4859 raft_consensus.cc:2229] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:50:47.641952 4859 raft_consensus.cc:2258] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:47.642077 4858 raft_consensus.cc:2258] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:50:47.642939 4862 ts_tablet_manager.cc:1905] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.643481 4859 ts_tablet_manager.cc:1905] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.643764 4858 ts_tablet_manager.cc:1905] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:50:47.644255 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 4006
I20260809 22:50:47.649804 4862 ts_tablet_manager.cc:1918] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:50:47.649952 4862 log.cc:1196] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/887294263dd2415d99e1067b62577bee
I20260809 22:50:47.650393 4862 ts_tablet_manager.cc:1939] T 887294263dd2415d99e1067b62577bee P 3b67e4b0a84440d58debdfdce88d532b: Deleting consensus metadata
I20260809 22:50:47.650393 4858 ts_tablet_manager.cc:1918] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:50:47.650527 4858 log.cc:1196] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/887294263dd2415d99e1067b62577bee
I20260809 22:50:47.650979 4858 ts_tablet_manager.cc:1939] T 887294263dd2415d99e1067b62577bee P eb3b46f0d70d42ed901c6cd0482ba81b: Deleting consensus metadata
I20260809 22:50:47.652055 4859 ts_tablet_manager.cc:1918] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 22:50:47.652256 4859 log.cc:1196] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/887294263dd2415d99e1067b62577bee
I20260809 22:50:47.652527 3863 catalog_manager.cc:4841] TS 3b67e4b0a84440d58debdfdce88d532b (127.23.131.67:35493): tablet 887294263dd2415d99e1067b62577bee (table test-table [id=cfa0ad8817c54ba7b42fcf3d509ab23b]) successfully deleted
I20260809 22:50:47.652921 4859 ts_tablet_manager.cc:1939] T 887294263dd2415d99e1067b62577bee P ec0c5af6c0af4aef933eb25461e459e4: Deleting consensus metadata
I20260809 22:50:47.654455 3862 catalog_manager.cc:4841] TS eb3b46f0d70d42ed901c6cd0482ba81b (127.23.131.65:45323): tablet 887294263dd2415d99e1067b62577bee (table test-table [id=cfa0ad8817c54ba7b42fcf3d509ab23b]) successfully deleted
I20260809 22:50:47.655001 3862 catalog_manager.cc:4841] TS ec0c5af6c0af4aef933eb25461e459e4 (127.23.131.66:38381): tablet 887294263dd2415d99e1067b62577bee (table test-table [id=cfa0ad8817c54ba7b42fcf3d509ab23b]) successfully deleted
Aug 09 22:50:47 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.65@KRBTEST.COM
I20260809 22:50:47.671680 4894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.645894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50500 (local address 127.23.131.65:45323)
0809 22:50:47.647053 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.647062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.655798 (+ 8736us) server_negotiation.cc:407] Connection header received
0809 22:50:47.656035 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.656041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.656128 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.656252 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:47.657692 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.658492 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.659925 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.660368 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.660519 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.664944 (+ 4425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:47.664964 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:47.664981 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:47.665027 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:47.668243 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:47.669067 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:47.669075 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:47.669077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:47.669238 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:47.669693 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:47.669698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:47.669701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:47.670172 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:47.670556 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:47.670947 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 22:50:47.671235 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":947}
I20260809 22:50:47.672493 4230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:47.807416 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 4006
I20260809 22:50:47.841800 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 4250
Aug 09 22:50:47 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.66@KRBTEST.COM
I20260809 22:50:47.857345 4916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:47.842610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55042 (local address 127.23.131.66:38381)
0809 22:50:47.842789 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:47.842793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:47.842877 (+ 84us) server_negotiation.cc:407] Connection header received
0809 22:50:47.843059 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:47.843063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:47.843130 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:47.843298 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:47.844539 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.845244 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.846515 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:47.847009 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:47.847120 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:47.851524 (+ 4404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:47.851540 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:47.851557 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:47.851594 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:47.854787 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:47.855594 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:47.855602 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:47.855604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:47.855728 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:47.856061 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:47.856064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:47.856066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:47.856432 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:47.856674 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:47.856875 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 22:50:47.857085 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:50:47.858099 4468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:47.988905 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 4250
I20260809 22:50:48.028137 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 4482
Aug 09 22:50:48 dist-test-slave-92m1 krb5kdc[3814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.131.67@KRBTEST.COM
I20260809 22:50:48.044852 4936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:48.029027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58900 (local address 127.23.131.67:35493)
0809 22:50:48.029492 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:48.029496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:48.029513 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:50:48.029571 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:48.029574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:48.029642 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:48.029737 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:48.031110 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:48.031936 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:48.033481 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:48.033880 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:48.033991 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:48.038707 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:48.038726 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:48.038744 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:48.038788 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:48.041979 (+ 3191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:48.042780 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:48.042788 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:48.042790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:48.042931 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:48.043311 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:48.043314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:48.043316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:48.043714 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:48.043975 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:48.044373 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 22:50:48.044569 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":228,"threads_started":1}
I20260809 22:50:48.045545 4693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:48.179858 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 4482
I20260809 22:50:48.213564 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 3832
I20260809 22:50:48.214807 3957 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:48.336495 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 3832
2026-08-09T22:50:48Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6734 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:48 dist-test-slave-92m1 krb5kdc[4946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:48 dist-test-slave-92m1 krb5kdc[4946](info): set up 2 sockets
Aug 09 22:50:48 dist-test-slave-92m1 krb5kdc[4946](info): commencing operation
krb5kdc: starting...
W20260809 22:50:49.714938 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.001s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:49 dist-test-slave-92m1 krb5kdc[4946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:50.038834 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44959
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:50.395020 4969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:50.395488 4969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:50.395605 4969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:50.403350 4969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:50.403479 4969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:50.403534 4969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:50.403594 4969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:50.403645 4969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:50.414295 4969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:50.415700 4969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:50.417117 4969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:50.430230 4977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:50.430351 4981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:50.430935 4976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:50.431423 4969 server_base.cc:1034] running on GCE node
I20260809 22:50:50.432339 4969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:50.433895 4969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:50.435118 4969 hybrid_clock.cc:648] HybridClock initialized: now 1786315850435155 us; error 140 us; skew 500 ppm
I20260809 22:50:50.435524 4969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T22:50:50Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2166 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:50:50 dist-test-slave-92m1 krb5kdc[4995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:50:50 dist-test-slave-92m1 krb5kdc[4995](info): set up 2 sockets
Aug 09 22:50:50 dist-test-slave-92m1 krb5kdc[4995](info): commencing operation
krb5kdc: starting...
W20260809 22:50:51.877799 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.010s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:50:52 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:50:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:50:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:50:52.211383 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41037
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:52.576783 5014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:52.577164 5014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:52.577334 5014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:52.584892 5014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:52.585088 5014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:52.585182 5014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:52.585273 5014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:52.585382 5014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:52.595871 5014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:52.597425 5014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:52.598855 5014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:52.611613 5021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:52.611696 5024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:52.611667 5020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:52.613858 5014 server_base.cc:1034] running on GCE node
I20260809 22:50:52.614796 5014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:52.616451 5014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:52.617717 5014 hybrid_clock.cc:648] HybridClock initialized: now 1786315852617663 us; error 33 us; skew 500 ppm
I20260809 22:50:52.618139 5014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:52 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315852, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:52.621690 5014 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:52.623385 5014 webserver.cc:460] Webserver started at http://127.23.131.126:42843/ using document root <none> and password file <none>
I20260809 22:50:52.624106 5014 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:52.624222 5014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:52.624519 5014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:52.627858 5014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "13c3e33e4f224e95a67fc378121e1e23"
format_stamp: "Formatted at 2026-08-09 22:50:52 on dist-test-slave-92m1"
server_key: "d0fb36645a73709d703567ccd7750798"
server_key_iv: "314a64e5f8208a33b033dcc52930e9bb"
server_key_version: "encryptionkey@0"
I20260809 22:50:52.628665 5014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "13c3e33e4f224e95a67fc378121e1e23"
format_stamp: "Formatted at 2026-08-09 22:50:52 on dist-test-slave-92m1"
server_key: "d0fb36645a73709d703567ccd7750798"
server_key_iv: "314a64e5f8208a33b033dcc52930e9bb"
server_key_version: "encryptionkey@0"
I20260809 22:50:52.634447 5014 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 22:50:52.638187 5035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:52.639678 5014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:52.639843 5014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "13c3e33e4f224e95a67fc378121e1e23"
format_stamp: "Formatted at 2026-08-09 22:50:52 on dist-test-slave-92m1"
server_key: "d0fb36645a73709d703567ccd7750798"
server_key_iv: "314a64e5f8208a33b033dcc52930e9bb"
server_key_version: "encryptionkey@0"
I20260809 22:50:52.640048 5014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:52.658228 5014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:52.663332 5014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:52.663625 5014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:52.685418 5014 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41037
I20260809 22:50:52.685434 5123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41037 every 8 connection(s)
I20260809 22:50:52.687041 5014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:52.690941 5124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:50:52.694993 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 5014
I20260809 22:50:52.695266 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:50:52.696123 24077 external_mini_cluster.cc:1428] Setting key fad11c4e70595ab75a1f4de6fd5f2db2
I20260809 22:50:52.706100 5124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Bootstrap starting.
I20260809 22:50:52.710480 5124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Neither blocks nor log segments found. Creating new log.
I20260809 22:50:52.712078 5124 log.cc:824] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:50:52 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:52.715495 5124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: No bootstrap required, opened a new log
I20260809 22:50:52.722244 5127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:52.698567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.23.131.126:41037)
0809 22:50:52.699679 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:52.699691 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:52.699737 (+ 46us) server_negotiation.cc:407] Connection header received
0809 22:50:52.701556 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:52.701583 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:52.702057 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:52.702458 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:52.704536 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:52.705908 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:52.707804 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:52.708564 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:52.708711 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:52.714113 (+ 5402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:52.714123 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:52.714139 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:52.714182 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:52.717651 (+ 3469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:52.718459 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:52.718476 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:52.718483 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:52.718671 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:52.719123 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:52.719127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:52.719129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:52.719786 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:52.720135 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:52.720651 (+ 516us) server_negotiation.cc:299] Negotiation successful
0809 22:50:52.721109 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":490,"threads_started":1}
I20260809 22:50:52.723933 5124 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:52.724436 5124 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:50:52.724561 5124 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13c3e33e4f224e95a67fc378121e1e23, State: Initialized, Role: FOLLOWER
I20260809 22:50:52.725250 5124 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:52.725574 5124 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:52.725724 5124 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:52.725914 5124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:50:52.728469 5124 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:52.729115 5124 leader_election.cc:302] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13c3e33e4f224e95a67fc378121e1e23; no voters:
I20260809 22:50:52.729723 5124 leader_election.cc:288] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:50:52.729888 5130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:50:52.730674 5130 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 LEADER]: Becoming Leader. State: Replica: 13c3e33e4f224e95a67fc378121e1e23, State: Running, Role: LEADER
I20260809 22:50:52.731324 5130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:52.732076 5124 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:52.734334 5134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13c3e33e4f224e95a67fc378121e1e23. Latest consensus state: current_term: 1 leader_uuid: "13c3e33e4f224e95a67fc378121e1e23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } } }
I20260809 22:50:52.734754 5134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:52.738227 5132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13c3e33e4f224e95a67fc378121e1e23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } } }
I20260809 22:50:52.738646 5132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:52.739305 5141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:52.745446 5141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:52.754325 5141 catalog_manager.cc:1347] Generated new cluster ID: ee5f9eb430024649816054337ce16406
I20260809 22:50:52.754463 5141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:52.764367 5141 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:50:52.765720 5141 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:52.772899 5141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Generated new TSK 0
I20260809 22:50:52.773770 5141 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:50:52.869050 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41037
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:53.231508 5160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:53.231839 5160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:53.232069 5160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:53.240666 5160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:53.240825 5160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:53.241036 5160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:53.252010 5160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:53.253500 5160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:53.254989 5160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:53.269495 5167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:53.269524 5168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:53.269562 5172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:53.270809 5160 server_base.cc:1034] running on GCE node
I20260809 22:50:53.271485 5160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:53.272591 5160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:53.273869 5160 hybrid_clock.cc:648] HybridClock initialized: now 1786315853273794 us; error 65 us; skew 500 ppm
I20260809 22:50:53.274266 5160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:53 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:53.277783 5160 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:50:53.279376 5160 webserver.cc:460] Webserver started at http://127.23.131.65:34631/ using document root <none> and password file <none>
I20260809 22:50:53.280098 5160 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:53.280233 5160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:53.280594 5160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:53.283948 5160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "c7aa2f653bab493683eaf4d20eacfc6b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "819027a56b44e38154add5b866ac7218"
server_key_iv: "986f25baf814d238dc85c167d530b15c"
server_key_version: "encryptionkey@0"
I20260809 22:50:53.284838 5160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "c7aa2f653bab493683eaf4d20eacfc6b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "819027a56b44e38154add5b866ac7218"
server_key_iv: "986f25baf814d238dc85c167d530b15c"
server_key_version: "encryptionkey@0"
I20260809 22:50:53.290481 5160 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:53.294442 5179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:53.296074 5160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:50:53.296272 5160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "c7aa2f653bab493683eaf4d20eacfc6b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "819027a56b44e38154add5b866ac7218"
server_key_iv: "986f25baf814d238dc85c167d530b15c"
server_key_version: "encryptionkey@0"
I20260809 22:50:53.296528 5160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:53.311293 5160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:53.315698 5160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:53.316059 5160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:53.317130 5160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:53.318576 5160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:53.318711 5160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:53.318877 5160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:53.318953 5160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:53.355911 5160 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:42375
I20260809 22:50:53.356038 5358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:42375 every 8 connection(s)
I20260809 22:50:53.357295 5160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:53.362754 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 5160
I20260809 22:50:53.362977 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:50:53.363749 24077 external_mini_cluster.cc:1428] Setting key abba0d8f416ec9ab7e87ff924c865832
Aug 09 22:50:53 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:53.378795 5361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:53.360078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58203 (local address 127.23.131.126:41037)
0809 22:50:53.360584 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:53.360589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:53.361361 (+ 772us) server_negotiation.cc:407] Connection header received
0809 22:50:53.363396 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:53.363401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:53.363498 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:53.363623 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:53.365240 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.366040 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.367758 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.368172 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.368335 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:53.372637 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:53.372642 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:53.372646 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:53.372680 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:53.375488 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:53.376278 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:53.376283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:53.376285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:53.376410 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:53.376925 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:53.376929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:53.376931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:53.377216 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:53.377387 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:53.378157 (+ 770us) server_negotiation.cc:299] Negotiation successful
0809 22:50:53.378398 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":270,"threads_started":1}
I20260809 22:50:53.379923 5364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:53.360463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:58203)
0809 22:50:53.361192 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:53.361231 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:53.363039 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:53.363909 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:53.363920 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:53.364455 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:53.365052 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:53.365070 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.366209 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.366214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:53.367606 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:53.367620 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.368427 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.368435 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:53.368708 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:53.369522 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:53.369560 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:53.372368 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:53.375651 (+ 3283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:53.375660 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:53.375679 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:53.376131 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:53.376538 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:53.376543 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:53.376548 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:53.376789 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:53.377357 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:53.377367 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:53.377745 (+ 378us) client_negotiation.cc:769] Sending connection context
0809 22:50:53.378024 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 22:50:53.378616 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":289,"threads_started":1}
I20260809 22:50:53.381631 5359 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41037
I20260809 22:50:53.381966 5359 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:53.382730 5359 heartbeater.cc:511] Master 127.23.131.126:41037 requested a full tablet report, sending...
I20260809 22:50:53.385296 5071 ts_manager.cc:194] Registered new tserver with Master: c7aa2f653bab493683eaf4d20eacfc6b (127.23.131.65:42375)
I20260809 22:50:53.387607 5071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:58203
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:50:53.436400 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41037
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:53.796515 5367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:53.796850 5367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:53.797019 5367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:53.804673 5367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:53.804839 5367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:53.805017 5367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:53.815155 5367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:53.816615 5367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:53.817994 5367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:53.832247 5376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:53.832291 5378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:53.832204 5375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:53.833441 5367 server_base.cc:1034] running on GCE node
I20260809 22:50:53.834143 5367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:53.835057 5367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:53.836277 5367 hybrid_clock.cc:648] HybridClock initialized: now 1786315853836247 us; error 61 us; skew 500 ppm
I20260809 22:50:53.836653 5367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:53 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:53.840081 5367 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:50:53.841753 5367 webserver.cc:460] Webserver started at http://127.23.131.66:40325/ using document root <none> and password file <none>
I20260809 22:50:53.842470 5367 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:53.842608 5367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:53.842944 5367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:53.846235 5367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "b153863520794b638b3f9c3780fbbb8b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "c94632768bd2d35c2d730bb4e6676af2"
server_key_iv: "37917a90e4eb3808c77dda2cd5260b5b"
server_key_version: "encryptionkey@0"
I20260809 22:50:53.847078 5367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "b153863520794b638b3f9c3780fbbb8b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "c94632768bd2d35c2d730bb4e6676af2"
server_key_iv: "37917a90e4eb3808c77dda2cd5260b5b"
server_key_version: "encryptionkey@0"
I20260809 22:50:53.852524 5367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 22:50:53.856123 5391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:53.857517 5367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:50:53.857699 5367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "b153863520794b638b3f9c3780fbbb8b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "c94632768bd2d35c2d730bb4e6676af2"
server_key_iv: "37917a90e4eb3808c77dda2cd5260b5b"
server_key_version: "encryptionkey@0"
I20260809 22:50:53.857918 5367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:53.871004 5367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:53.875324 5367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:53.875643 5367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:53.876685 5367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:53.878185 5367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:53.878293 5367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:53.878471 5367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:53.878561 5367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:53.914697 5367 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:39107
I20260809 22:50:53.914749 5565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:39107 every 8 connection(s)
I20260809 22:50:53.916169 5367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:53.919615 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 5367
I20260809 22:50:53.919817 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:50:53.920300 24077 external_mini_cluster.cc:1428] Setting key e36c185ca1f8f9760759219ecc4d40d8
Aug 09 22:50:53 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:53.937630 5570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:53.918734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:36169 (local address 127.23.131.126:41037)
0809 22:50:53.919163 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:53.919167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:53.920704 (+ 1537us) server_negotiation.cc:407] Connection header received
0809 22:50:53.922611 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:53.922617 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:53.922710 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:53.922832 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:53.924454 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.925220 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.926817 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.927312 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.927447 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:53.931274 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:53.931280 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:53.931283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:53.931318 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:53.934234 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:53.935029 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:53.935035 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:53.935038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:53.935184 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:53.935719 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:53.935725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:53.935729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:53.936039 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:53.936219 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:53.936987 (+ 768us) server_negotiation.cc:299] Negotiation successful
0809 22:50:53.937237 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":212,"threads_started":1}
I20260809 22:50:53.938679 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:53.919362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:36169)
0809 22:50:53.920232 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:53.920289 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:53.922307 (+ 2018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:53.923095 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:53.923103 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:53.923718 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:53.924278 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:53.924295 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.925385 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.925389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:53.926637 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:53.926649 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:53.927572 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:53.927583 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:53.927810 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:53.928535 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:53.928559 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:53.931018 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:53.934395 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:53.934405 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:53.934423 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:53.934893 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:53.935363 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:53.935369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:53.935372 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:53.935597 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:53.936192 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:53.936200 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:53.936596 (+ 396us) client_negotiation.cc:769] Sending connection context
0809 22:50:53.936883 (+ 287us) client_negotiation.cc:240] Negotiation successful
0809 22:50:53.937469 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":379,"threads_started":1}
I20260809 22:50:53.940340 5567 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41037
I20260809 22:50:53.940709 5567 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:53.941504 5567 heartbeater.cc:511] Master 127.23.131.126:41037 requested a full tablet report, sending...
I20260809 22:50:53.943123 5071 ts_manager.cc:194] Registered new tserver with Master: b153863520794b638b3f9c3780fbbb8b (127.23.131.66:39107)
I20260809 22:50:53.944449 5071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:36169
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:50:53.990971 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41037
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:54.356583 5574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:54.357028 5574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:54.357214 5574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:54.368638 5574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:54.368798 5574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:54.368992 5574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:54.379501 5574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:54.380843 5574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:54.382207 5574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 22:50:54.391040 5359 heartbeater.cc:503] Master 127.23.131.126:41037 was elected leader, sending a full tablet report...
W20260809 22:50:54.396822 5581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:54.396893 5586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:54.396965 5582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:54.398463 5574 server_base.cc:1034] running on GCE node
I20260809 22:50:54.399148 5574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:54.400302 5574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:54.401582 5574 hybrid_clock.cc:648] HybridClock initialized: now 1786315854401504 us; error 41 us; skew 500 ppm
I20260809 22:50:54.401991 5574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:54 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315854, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:54.405551 5574 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:50:54.407384 5574 webserver.cc:460] Webserver started at http://127.23.131.67:40979/ using document root <none> and password file <none>
I20260809 22:50:54.408161 5574 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:54.408329 5574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:54.408684 5574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:50:54.411965 5574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "4a7684f565fc4ac4bf8cdfd6270b8d58"
format_stamp: "Formatted at 2026-08-09 22:50:54 on dist-test-slave-92m1"
server_key: "58ae98e939939324a97dc09b190024f8"
server_key_iv: "12f233dbe72beebd00d18d5d9089988f"
server_key_version: "encryptionkey@0"
I20260809 22:50:54.412870 5574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "4a7684f565fc4ac4bf8cdfd6270b8d58"
format_stamp: "Formatted at 2026-08-09 22:50:54 on dist-test-slave-92m1"
server_key: "58ae98e939939324a97dc09b190024f8"
server_key_iv: "12f233dbe72beebd00d18d5d9089988f"
server_key_version: "encryptionkey@0"
I20260809 22:50:54.418517 5574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:50:54.422233 5595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:54.423668 5574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:54.423862 5574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "4a7684f565fc4ac4bf8cdfd6270b8d58"
format_stamp: "Formatted at 2026-08-09 22:50:54 on dist-test-slave-92m1"
server_key: "58ae98e939939324a97dc09b190024f8"
server_key_iv: "12f233dbe72beebd00d18d5d9089988f"
server_key_version: "encryptionkey@0"
I20260809 22:50:54.424088 5574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:54.461297 5574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:54.466122 5574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:54.466437 5574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:54.467561 5574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:54.469007 5574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:54.469131 5574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:54.469286 5574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:54.469360 5574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:54.505728 5574 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:36307
I20260809 22:50:54.505774 5784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:36307 every 8 connection(s)
I20260809 22:50:54.507115 5574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:54.515945 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 5574
I20260809 22:50:54.516145 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:50:54.516721 24077 external_mini_cluster.cc:1428] Setting key 7284b2c313b9b90e8357eab1332a0ed2
Aug 09 22:50:54 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315854, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:50:54.529219 5792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:54.510008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:56263 (local address 127.23.131.126:41037)
0809 22:50:54.510626 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:54.510633 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:54.511601 (+ 968us) server_negotiation.cc:407] Connection header received
0809 22:50:54.513564 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:54.513569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:54.513642 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:54.513749 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:54.515377 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.516645 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.518598 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.519104 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.519293 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:54.523076 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:54.523081 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:54.523084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:54.523119 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:54.525951 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:54.526710 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:54.526714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:54.526716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:54.526837 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:54.527354 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:54.527357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:54.527359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:54.527636 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:54.527812 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:54.528655 (+ 843us) server_negotiation.cc:299] Negotiation successful
0809 22:50:54.528832 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":260,"threads_started":1}
I20260809 22:50:54.530334 5793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:54.510624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:56263)
0809 22:50:54.511410 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:54.511462 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:54.513254 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:54.513977 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:54.513987 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:54.514542 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:54.515128 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:54.515151 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.516849 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.516856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:54.518444 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:54.518456 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.519458 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.519464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:54.519680 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:54.520516 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:54.520561 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:54.522839 (+ 2278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:50:54.526104 (+ 3265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:54.526122 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:54.526135 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:54.526597 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:54.526962 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:50:54.526965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:50:54.526967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:50:54.527159 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:50:54.527796 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:50:54.527807 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:50:54.528271 (+ 464us) client_negotiation.cc:769] Sending connection context
0809 22:50:54.528568 (+ 297us) client_negotiation.cc:240] Negotiation successful
0809 22:50:54.529083 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":307,"threads_started":1}
I20260809 22:50:54.532117 5786 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41037
I20260809 22:50:54.532521 5786 heartbeater.cc:464] Registering TS with master...
I20260809 22:50:54.533411 5786 heartbeater.cc:511] Master 127.23.131.126:41037 requested a full tablet report, sending...
I20260809 22:50:54.534798 5071 ts_manager.cc:194] Registered new tserver with Master: 4a7684f565fc4ac4bf8cdfd6270b8d58 (127.23.131.67:36307)
I20260809 22:50:54.535665 5071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:56263
I20260809 22:50:54.546257 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab.
Entry for principal oryx/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab.
WARNING: no policy specified for oryx/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab.
Entry for principal oryx/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab.
WARNING: no policy specified for oryx/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab.
Entry for principal oryx/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab.
I20260809 22:50:54.749511 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5160
Aug 09 22:50:54 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:50:54.767175 5801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:54.750814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43148 (local address 127.23.131.65:42375)
0809 22:50:54.751566 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:54.751577 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:54.751605 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:50:54.751669 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:54.751675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:54.751884 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:54.752026 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:54.753467 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.754505 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.755904 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.756481 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.756579 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:54.761259 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:54.761274 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:54.761288 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:54.761352 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:54.764448 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:54.765199 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:54.765206 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:54.765209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:54.765348 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:54.765691 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:54.765695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:54.765697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:54.766095 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:54.766342 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:54.766602 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 22:50:54.766822 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":425,"threads_started":1}
I20260809 22:50:54.768637 5353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:54.856312 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 5160
I20260809 22:50:54.883424 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5367
Aug 09 22:50:54 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:50:54.901412 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:54.884405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60308 (local address 127.23.131.66:39107)
0809 22:50:54.885042 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:54.885051 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:54.885078 (+ 27us) server_negotiation.cc:407] Connection header received
0809 22:50:54.885143 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:54.885150 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:54.885367 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:54.885508 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:54.886853 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.888076 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.889558 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:54.890168 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:54.890283 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:54.895184 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:54.895200 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:54.895384 (+ 184us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:54.895434 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:54.898582 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:54.899352 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:54.899360 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:54.899362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:54.899505 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:54.899926 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:54.899929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:54.899931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:54.900288 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:54.900527 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:54.900864 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 22:50:54.901113 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":305,"threads_started":1}
I20260809 22:50:54.902755 5560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:54.988441 5567 heartbeater.cc:503] Master 127.23.131.126:41037 was elected leader, sending a full tablet report...
I20260809 22:50:54.990181 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 5367
I20260809 22:50:55.014447 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5574
Aug 09 22:50:55 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:50:55.038451 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:55.015509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.23.131.67:36307)
0809 22:50:55.016075 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:55.016083 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:55.016113 (+ 30us) server_negotiation.cc:407] Connection header received
0809 22:50:55.016177 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:55.016183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:55.016395 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:55.016584 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:55.018009 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:55.019024 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:55.020495 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:55.021082 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:55.021243 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:55.027087 (+ 5844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:55.027100 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:55.027116 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:55.027160 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:55.031985 (+ 4825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:55.035609 (+ 3624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:55.035620 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:55.035627 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:55.035857 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:55.036355 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:55.036361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:55.036364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:55.036900 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:55.037215 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:55.037597 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 22:50:55.037902 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":255,"threads_started":1}
I20260809 22:50:55.039983 5779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:55.140046 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 5574
I20260809 22:50:55.168295 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5014
I20260809 22:50:55.169659 5119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:50:55.279125 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 5014
I20260809 22:50:55.310322 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41037
--webserver_interface=127.23.131.126
--webserver_port=42843
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:50:55.662014 5812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:55.662315 5812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:55.662406 5812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:55.669952 5812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:50:55.670069 5812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:55.670117 5812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:55.670176 5812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:50:55.670221 5812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:50:55.680267 5812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=42843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:55.681588 5812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:55.682883 5812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:55.695742 5820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:55.695827 5818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:55.695815 5823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:55.696635 5812 server_base.cc:1034] running on GCE node
I20260809 22:50:55.697551 5812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:55.699090 5812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:55.700332 5812 hybrid_clock.cc:648] HybridClock initialized: now 1786315855700291 us; error 72 us; skew 500 ppm
I20260809 22:50:55.700698 5812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:55 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315855, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:55.707939 5812 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:50:55.709615 5812 webserver.cc:460] Webserver started at http://127.23.131.126:42843/ using document root <none> and password file <none>
I20260809 22:50:55.710368 5812 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:55.710570 5812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:55.716566 5812 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 22:50:55.719843 5833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:55.721331 5812 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:50:55.721544 5812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "13c3e33e4f224e95a67fc378121e1e23"
format_stamp: "Formatted at 2026-08-09 22:50:52 on dist-test-slave-92m1"
server_key: "d0fb36645a73709d703567ccd7750798"
server_key_iv: "314a64e5f8208a33b033dcc52930e9bb"
server_key_version: "encryptionkey@0"
I20260809 22:50:55.722633 5812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:55.753204 5812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:55.758001 5812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:55.758337 5812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:55.779901 5812 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41037
I20260809 22:50:55.779902 5925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41037 every 8 connection(s)
I20260809 22:50:55.781644 5812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:50:55.783542 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 5812
I20260809 22:50:55.784575 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:42375
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:41037
--webserver_port=34631
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:50:55.791574 5927 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:50:55.796689 5927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Bootstrap starting.
I20260809 22:50:55.817857 5927 log.cc:824] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Log is configured to *not* fsync() on all Append() calls
I20260809 22:50:55.827994 5927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:50:55.828593 5927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Bootstrap complete.
I20260809 22:50:55.838232 5927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:55.839085 5927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13c3e33e4f224e95a67fc378121e1e23, State: Initialized, Role: FOLLOWER
I20260809 22:50:55.839851 5927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:55.840106 5927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:50:55.840224 5927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:50:55.840426 5927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 1 FOLLOWER]: Advancing to term 2
I20260809 22:50:55.844409 5927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:55.844935 5927 leader_election.cc:302] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13c3e33e4f224e95a67fc378121e1e23; no voters:
I20260809 22:50:55.845610 5927 leader_election.cc:288] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 22:50:55.845752 5934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 22:50:55.847151 5934 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [term 2 LEADER]: Becoming Leader. State: Replica: 13c3e33e4f224e95a67fc378121e1e23, State: Running, Role: LEADER
I20260809 22:50:55.847833 5934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } }
I20260809 22:50:55.848078 5927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:50:55.850584 5937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13c3e33e4f224e95a67fc378121e1e23. Latest consensus state: current_term: 2 leader_uuid: "13c3e33e4f224e95a67fc378121e1e23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } } }
I20260809 22:50:55.851058 5937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:55.856426 5936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "13c3e33e4f224e95a67fc378121e1e23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13c3e33e4f224e95a67fc378121e1e23" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41037 } } }
I20260809 22:50:55.856840 5936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23 [sys.catalog]: This master's current role is: LEADER
I20260809 22:50:55.858500 5944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:50:55.865667 5944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:50:55.867723 5944 catalog_manager.cc:1259] Loaded cluster ID: ee5f9eb430024649816054337ce16406
I20260809 22:50:55.867929 5944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:50:55.872725 5944 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:50:55.874627 5944 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 13c3e33e4f224e95a67fc378121e1e23: Loaded TSK: 0
I20260809 22:50:55.876410 5944 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 22:50:56.166019 5931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:56.166369 5931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:56.166567 5931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:56.174130 5931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:56.174296 5931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:56.174494 5931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:50:56.184813 5931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.65.keytab
--principal=oryx/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:42375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=34631
--tserver_master_addrs=127.23.131.126:41037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:56.186299 5931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:56.187817 5931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:56.203641 5972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:56.203886 5971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:56.204788 5974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:56.205358 5931 server_base.cc:1034] running on GCE node
I20260809 22:50:56.206094 5931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:56.207289 5931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:56.208536 5931 hybrid_clock.cc:648] HybridClock initialized: now 1786315856208472 us; error 55 us; skew 500 ppm
I20260809 22:50:56.208886 5931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315856, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:56.212682 5931 init.cc:377] Logged in from keytab as oryx/127.23.131.65@KRBTEST.COM (short username oryx)
I20260809 22:50:56.214556 5931 webserver.cc:460] Webserver started at http://127.23.131.65:34631/ using document root <none> and password file <none>
I20260809 22:50:56.215494 5931 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:56.215651 5931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:56.222694 5931 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 22:50:56.225947 5990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:56.227632 5931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 22:50:56.227820 5931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "c7aa2f653bab493683eaf4d20eacfc6b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "819027a56b44e38154add5b866ac7218"
server_key_iv: "986f25baf814d238dc85c167d530b15c"
server_key_version: "encryptionkey@0"
I20260809 22:50:56.228832 5931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:56.244884 5931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:56.249588 5931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:56.249894 5931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:56.251024 5931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:56.252543 5931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:56.252689 5931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:56.252821 5931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:56.252919 5931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:56.287458 5931 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:42375
I20260809 22:50:56.287554 6197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:42375 every 8 connection(s)
I20260809 22:50:56.289062 5931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:50:56.292102 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 5931
I20260809 22:50:56.292855 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:39107
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:41037
--webserver_port=40325
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:56.311398 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:56.292352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:58267)
0809 22:50:56.294199 (+ 1847us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:56.294268 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:56.297097 (+ 2829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:56.298574 (+ 1477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:56.298587 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:56.299432 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:56.300220 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.300248 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.301821 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.301829 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.303997 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.304017 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.305110 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.305119 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.305441 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.306213 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:56.306247 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:56.310327 (+ 4080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1512,"thread_start_us":1265,"threads_started":1}
W20260809 22:50:56.311956 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:56.292339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58267 (local address 127.23.131.126:41037)
0809 22:50:56.293526 (+ 1187us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:56.293544 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:56.294446 (+ 902us) server_negotiation.cc:407] Connection header received
0809 22:50:56.297713 (+ 3267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:56.297726 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:56.298064 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:56.298356 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:56.300437 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.301649 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.304178 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.304857 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.304997 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.310792 (+ 5795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:58267: BlockingRecv error: recv got EOF from 127.23.131.65:58267 (error 108)
Metrics: {"server-negotiator.queue_time_us":881,"thread_start_us":346,"threads_started":1}
W20260809 22:50:56.312090 6198 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:41037 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.131.126:41037: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:56.322343 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:56.312728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:54585)
0809 22:50:56.312955 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:56.312977 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:56.313097 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:56.313406 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:56.313413 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:56.313879 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:56.314106 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.314120 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.315275 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.315283 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.316927 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.316946 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.317677 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.317685 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.317904 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.318583 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:56.318611 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:56.322136 (+ 3525us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 22:50:56.322747 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:56.312963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:54585 (local address 127.23.131.126:41037)
0809 22:50:56.313140 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:56.313144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:56.313162 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:50:56.313209 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:56.313212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:56.313268 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:56.313347 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:56.314283 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.315073 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.317101 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.317515 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.317631 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.322458 (+ 4827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:54585: BlockingRecv error: recv got EOF from 127.23.131.65:54585 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:56.332677 6202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:56.323308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:53745)
0809 22:50:56.323511 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:56.323536 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:56.323624 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:56.324030 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:56.324034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:56.324338 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:56.324506 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.324515 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.326109 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.326113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.327149 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.327161 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.328344 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.328349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.328519 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.329193 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:56.329211 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:56.332397 (+ 3186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 22:50:56.332934 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:56.323421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53745 (local address 127.23.131.126:41037)
0809 22:50:56.323636 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:56.323644 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:56.323670 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:50:56.323736 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:56.323742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:56.323849 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:56.323972 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:56.324666 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.325949 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.327375 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.328181 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.328334 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.332658 (+ 4324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:53745: BlockingRecv error: recv got EOF from 127.23.131.65:53745 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 22:50:56.333132 6198 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 22:50:56.667062 6203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:56.667441 6203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:56.667554 6203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:56.674969 6203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:56.675078 6203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:56.675192 6203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:50:56.685195 6203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.66.keytab
--principal=oryx/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:39107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=40325
--tserver_master_addrs=127.23.131.126:41037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:56.686537 6203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:56.687826 6203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:56.701792 6212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:56.701915 6217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:56.702126 6213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:56.703193 6203 server_base.cc:1034] running on GCE node
I20260809 22:50:56.703855 6203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:56.704804 6203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:56.706022 6203 hybrid_clock.cc:648] HybridClock initialized: now 1786315856705966 us; error 39 us; skew 500 ppm
I20260809 22:50:56.706362 6203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315856, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:56.709803 6203 init.cc:377] Logged in from keytab as oryx/127.23.131.66@KRBTEST.COM (short username oryx)
I20260809 22:50:56.711519 6203 webserver.cc:460] Webserver started at http://127.23.131.66:40325/ using document root <none> and password file <none>
I20260809 22:50:56.712258 6203 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:56.712426 6203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:56.717839 6203 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 22:50:56.720649 6229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:56.721982 6203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:50:56.722182 6203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "b153863520794b638b3f9c3780fbbb8b"
format_stamp: "Formatted at 2026-08-09 22:50:53 on dist-test-slave-92m1"
server_key: "c94632768bd2d35c2d730bb4e6676af2"
server_key_iv: "37917a90e4eb3808c77dda2cd5260b5b"
server_key_version: "encryptionkey@0"
I20260809 22:50:56.723186 6203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:56.749130 6203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:56.753414 6203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:56.753742 6203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:56.754984 6203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:56.756507 6203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:56.756640 6203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:56.756779 6203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:56.756877 6203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:56.798032 6203 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:39107
I20260809 22:50:56.798127 6417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:39107 every 8 connection(s)
I20260809 22:50:56.799604 6203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:50:56.801523 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 6203
I20260809 22:50:56.802309 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:36307
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:41037
--webserver_port=40979
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 22:50:56.816850 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:56.802462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:54925 (local address 127.23.131.126:41037)
0809 22:50:56.802708 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:56.802713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:56.804072 (+ 1359us) server_negotiation.cc:407] Connection header received
0809 22:50:56.806086 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:56.806092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:56.806190 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:56.806309 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:56.808133 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.808846 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.810443 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.810891 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.811106 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.816650 (+ 5544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:54925: BlockingRecv error: recv got EOF from 127.23.131.66:54925 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
I20260809 22:50:56.817915 6424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:56.802973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:54925)
0809 22:50:56.803878 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:56.803916 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:56.805770 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:56.806581 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:56.806590 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:56.807130 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:56.807818 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.807837 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.809019 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.809025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.810277 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.810290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.811252 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.811262 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.811510 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.812266 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:56.812290 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:56.816476 (+ 4186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":407,"threads_started":1}
W20260809 22:50:56.818658 6419 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:41037 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.131.126:41037: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:56.827965 6424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:56.819337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:57787)
0809 22:50:56.819539 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:56.819556 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:56.819693 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:56.820041 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:56.820045 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:56.820406 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:56.820562 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.820570 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.821623 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.821628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.822563 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.822574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.823396 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.823402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.823592 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.824220 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:56.824237 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:56.827621 (+ 3384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 22:50:56.828254 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:56.819536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:57787 (local address 127.23.131.126:41037)
0809 22:50:56.819728 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:56.819736 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:56.819758 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:50:56.819822 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:56.819832 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:56.819896 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:56.820003 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:56.820713 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.821475 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.822718 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.823150 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.823383 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.827941 (+ 4558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:57787: BlockingRecv error: recv got EOF from 127.23.131.66:57787 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:56 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:56.838088 6424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:56.828978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:38411)
0809 22:50:56.829167 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:56.829185 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:56.829321 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:56.829739 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:56.829742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:56.830025 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:56.830174 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.830182 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.831808 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.831811 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.832814 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:56.832826 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.834036 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.834040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:56.834170 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.834826 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:56.834842 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:56.837861 (+ 3019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 22:50:56.838430 6419 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 22:50:56.838743 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:56.829091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:38411 (local address 127.23.131.126:41037)
0809 22:50:56.829297 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:56.829303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:56.829326 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:50:56.829467 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:56.829476 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:56.829584 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:56.829697 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:56.830323 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.831664 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.832963 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:56.833826 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:56.834040 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:56.838169 (+ 4129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:38411: BlockingRecv error: recv got EOF from 127.23.131.66:38411 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 22:50:57.162799 6426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:50:57.163091 6426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:50:57.163247 6426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:50:57.171360 6426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:50:57.171474 6426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:50:57.171600 6426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:50:57.181787 6426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/krb5kdc/oryx_127.23.131.67.keytab
--principal=oryx/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:36307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=40979
--tserver_master_addrs=127.23.131.126:41037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:50:57.183126 6426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:50:57.184415 6426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:50:57.199118 6433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:57.199047 6436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:50:57.199144 6434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:50:57.200098 6426 server_base.cc:1034] running on GCE node
I20260809 22:50:57.200707 6426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:50:57.201678 6426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:50:57.202906 6426 hybrid_clock.cc:648] HybridClock initialized: now 1786315857202825 us; error 64 us; skew 500 ppm
I20260809 22:50:57.203279 6426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315857, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:50:57.206605 6426 init.cc:377] Logged in from keytab as oryx/127.23.131.67@KRBTEST.COM (short username oryx)
I20260809 22:50:57.208184 6426 webserver.cc:460] Webserver started at http://127.23.131.67:40979/ using document root <none> and password file <none>
I20260809 22:50:57.209043 6426 fs_manager.cc:359] Metadata directory not provided
I20260809 22:50:57.209209 6426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:50:57.214855 6426 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 22:50:57.217664 6445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:57.219007 6426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:50:57.219184 6426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "4a7684f565fc4ac4bf8cdfd6270b8d58"
format_stamp: "Formatted at 2026-08-09 22:50:54 on dist-test-slave-92m1"
server_key: "58ae98e939939324a97dc09b190024f8"
server_key_iv: "12f233dbe72beebd00d18d5d9089988f"
server_key_version: "encryptionkey@0"
I20260809 22:50:57.220266 6426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:50:57.238030 6426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:50:57.242736 6426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:50:57.243067 6426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:50:57.244218 6426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:50:57.245628 6426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:50:57.245779 6426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:57.245916 6426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:50:57.246014 6426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:50:57.282086 6426 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:36307
I20260809 22:50:57.282182 6648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:36307 every 8 connection(s)
I20260809 22:50:57.283704 6426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:50:57.288489 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 6426
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 22:50:57.304252 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:57.286359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:48113 (local address 127.23.131.126:41037)
0809 22:50:57.286585 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:57.286592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:57.287975 (+ 1383us) server_negotiation.cc:407] Connection header received
0809 22:50:57.290516 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:57.290526 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:57.290644 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:57.290737 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:57.293739 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.295327 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.297339 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.298051 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.298210 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.303962 (+ 5752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:48113: BlockingRecv error: recv got EOF from 127.23.131.67:48113 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 22:50:57.305028 6651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:57.286799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:48113)
0809 22:50:57.287729 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:57.287782 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:57.290055 (+ 2273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:57.291443 (+ 1388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:57.291460 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:57.292439 (+ 979us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:57.293454 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.293489 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.295619 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.295624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.297180 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.297193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.298334 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.298342 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.298695 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.299541 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:57.299579 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:57.303759 (+ 4180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":380,"threads_started":1}
W20260809 22:50:57.305778 6649 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:41037 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.131.126:41037: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
I20260809 22:50:57.311626 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:57.289670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.23.131.126:41037)
0809 22:50:57.295655 (+ 5985us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:57.295663 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:57.296025 (+ 362us) server_negotiation.cc:407] Connection header received
0809 22:50:57.296267 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:57.296278 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:57.296344 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:57.296457 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:57.298334 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.299489 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.300793 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.301488 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.301620 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.304388 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:50:57.304402 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:50:57.304426 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:50:57.304477 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:50:57.308044 (+ 3567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:57.308842 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:57.308853 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:57.308864 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:57.309147 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:50:57.309561 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:50:57.309566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:50:57.309569 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:50:57.310059 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:50:57.310421 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0809 22:50:57.310884 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 22:50:57.311319 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5831,"thread_start_us":5675,"threads_started":1}
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:57.315536 6651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:57.306456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:43813)
0809 22:50:57.306669 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:57.306689 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:57.306801 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:57.307149 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:57.307153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:57.307558 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:57.307704 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.307713 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.308748 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.308754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.309756 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.309768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.310530 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.310536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.310714 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.311435 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:57.311453 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:57.315194 (+ 3741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 22:50:57.315697 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:57.306538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:43813 (local address 127.23.131.126:41037)
0809 22:50:57.306731 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:57.306736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:57.306754 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:50:57.306932 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:57.306937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:57.307011 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:57.307122 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:57.307851 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.308602 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.309904 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.310377 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.310522 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.315436 (+ 4914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:43813: BlockingRecv error: recv got EOF from 127.23.131.67:43813 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:57.324093 6651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:57.316366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:55343)
0809 22:50:57.316532 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:57.316548 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:57.316636 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:57.316973 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:57.316976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:57.317268 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:57.317425 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.317434 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.318443 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.318447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.319479 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.319492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.320151 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.320154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.320308 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.320869 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:57.320886 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:57.323800 (+ 2914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 22:50:57.324410 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:57.316463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:55343 (local address 127.23.131.126:41037)
0809 22:50:57.316698 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:57.316702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:57.316716 (+ 14us) server_negotiation.cc:407] Connection header received
0809 22:50:57.316756 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:57.316760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:57.316812 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:57.316906 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:57.317547 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.318297 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.319604 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.320025 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.320119 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.324013 (+ 3894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:55343: BlockingRecv error: recv got EOF from 127.23.131.67:55343 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
W20260809 22:50:57.324443 6649 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:57.342849 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:57.333777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:35105)
0809 22:50:57.334381 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:57.334402 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:57.334575 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:57.334949 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:57.334954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:57.335577 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:57.335780 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.335790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.336855 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.336861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.337849 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.337860 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.338660 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.338666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.338846 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.339590 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:57.339609 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:57.342616 (+ 3007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":349,"threads_started":1}
W20260809 22:50:57.343045 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:57.333885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:35105 (local address 127.23.131.126:41037)
0809 22:50:57.334156 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:57.334164 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:57.334496 (+ 332us) server_negotiation.cc:407] Connection header received
0809 22:50:57.334717 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:57.334721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:57.334784 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:57.334892 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:57.335936 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.336701 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.337993 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.338428 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.338588 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.342836 (+ 4248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:35105: BlockingRecv error: recv got EOF from 127.23.131.65:35105 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:57 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:57.848389 6656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:57.839099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:48187)
0809 22:50:57.839716 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:57.839733 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:57.839901 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:57.840260 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:57.840265 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:57.840784 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:57.840994 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.841004 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.842077 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.842083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.843074 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:57.843086 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.843914 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.843920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:57.844104 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.844703 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:57.844721 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:57.848082 (+ 3361us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":357,"threads_started":1}
W20260809 22:50:57.848668 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:57.839235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:48187 (local address 127.23.131.126:41037)
0809 22:50:57.839480 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:57.839489 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:57.839820 (+ 331us) server_negotiation.cc:407] Connection header received
0809 22:50:57.840028 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:57.840034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:57.840117 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:57.840222 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:57.841155 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.841902 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.843254 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:57.843716 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:57.843864 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:57.848335 (+ 4471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:48187: BlockingRecv error: recv got EOF from 127.23.131.66:48187 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 22:50:58 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:58 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:58.334247 6659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:58.325117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:37757)
0809 22:50:58.325688 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:58.325703 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:58.325870 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:58.326223 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:58.326226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:58.326760 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:58.327025 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:58.327036 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.328178 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.328182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:58.329173 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:58.329185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.329905 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.329909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:58.330036 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:58.330683 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:58.330700 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:58.333873 (+ 3173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":329,"threads_started":1}
W20260809 22:50:58.334326 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:58.325111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:37757 (local address 127.23.131.126:41037)
0809 22:50:58.325299 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:58.325305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:58.325799 (+ 494us) server_negotiation.cc:407] Connection header received
0809 22:50:58.326020 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:58.326024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:58.326085 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:58.326162 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:58.327200 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.328016 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.329329 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.329735 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.329834 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:58.334091 (+ 4257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:37757: BlockingRecv error: recv got EOF from 127.23.131.67:37757 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 22:50:58 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:58 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:58.353368 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:58.343898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:54199)
0809 22:50:58.344528 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:58.344550 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:58.344727 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:58.345121 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:58.345126 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:58.345587 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:58.345769 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:58.345778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.346871 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.346879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:58.347952 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:58.347964 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.348718 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.348724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:58.349224 (+ 500us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:58.350025 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:58.350051 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:58.353108 (+ 3057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":349,"threads_started":1}
W20260809 22:50:58.353701 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:58.343993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:54199 (local address 127.23.131.126:41037)
0809 22:50:58.344332 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:58.344339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:58.344653 (+ 314us) server_negotiation.cc:407] Connection header received
0809 22:50:58.344870 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:58.344874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:58.344971 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:58.345083 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:58.345924 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.346734 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.348103 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.348550 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.348701 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:58.353347 (+ 4646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:54199: BlockingRecv error: recv got EOF from 127.23.131.65:54199 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Aug 09 22:50:58 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:58 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:58.859051 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:58.849682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:52693)
0809 22:50:58.850308 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:58.850324 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:58.850492 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:58.850853 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:58.850860 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:58.851404 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:58.851593 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:58.851603 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.852659 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.852664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:58.853574 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:58.853586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.854320 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.854325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:58.854491 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:58.855185 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:58.855244 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:58.858783 (+ 3539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":360,"threads_started":1}
W20260809 22:50:58.859263 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:58.849791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:52693 (local address 127.23.131.126:41037)
0809 22:50:58.850002 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:58.850011 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:58.850422 (+ 411us) server_negotiation.cc:407] Connection header received
0809 22:50:58.850633 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:58.850637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:58.850704 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:58.850811 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:58.851749 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.852503 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.853721 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:58.854157 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:58.854308 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:58.859001 (+ 4693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:52693: BlockingRecv error: recv got EOF from 127.23.131.66:52693 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 22:50:59 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:59 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:59.345161 6663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:59.335565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:45191)
0809 22:50:59.336240 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:59.336258 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:59.336397 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:59.336736 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:59.336739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:59.337220 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:59.337416 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:59.337427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.338487 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.338492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:59.339420 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:59.339433 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.340411 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.340417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:59.340623 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:59.341325 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:59.341343 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:59.344740 (+ 3397us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":367,"threads_started":1}
W20260809 22:50:59.345270 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:59.335713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:45191 (local address 127.23.131.126:41037)
0809 22:50:59.335928 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:59.335933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:59.336353 (+ 420us) server_negotiation.cc:407] Connection header received
0809 22:50:59.336521 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:59.336524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:59.336589 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:59.336673 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:59.337564 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.338315 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.339578 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.340206 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.340352 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:59.344983 (+ 4631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:45191: BlockingRecv error: recv got EOF from 127.23.131.67:45191 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 09 22:50:59 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:59 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:59.363029 6664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:59.354406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:34303)
0809 22:50:59.354985 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:59.355014 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:59.355137 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:59.355610 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:59.355613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:59.355999 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:59.356171 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:59.356179 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.357119 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.357122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:59.358060 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:59.358071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.358689 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.358692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:59.358826 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:59.359568 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:59.359585 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:59.362754 (+ 3169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":317,"threads_started":1}
W20260809 22:50:59.363370 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:59.354462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:34303 (local address 127.23.131.126:41037)
0809 22:50:59.354650 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:59.354655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:59.355109 (+ 454us) server_negotiation.cc:407] Connection header received
0809 22:50:59.355383 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:59.355387 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:59.355473 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:59.355554 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:59.356296 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.356985 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.358179 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.358567 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.358657 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:59.363000 (+ 4343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:34303: BlockingRecv error: recv got EOF from 127.23.131.65:34303 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 22:50:59 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:50:59 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:50:59.869307 6665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:50:59.860294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:57141)
0809 22:50:59.860873 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 22:50:59.860900 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 22:50:59.861075 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:50:59.861541 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:50:59.861549 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:50:59.862071 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:50:59.862295 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:59.862306 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.863542 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.863546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:59.864443 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:50:59.864454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.865213 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.865217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:50:59.865348 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:59.865974 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:50:59.865990 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:50:59.869038 (+ 3048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":293,"threads_started":1}
W20260809 22:50:59.869503 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:50:59.860351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:57141 (local address 127.23.131.126:41037)
0809 22:50:59.860604 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 22:50:59.860613 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:50:59.861026 (+ 413us) server_negotiation.cc:407] Connection header received
0809 22:50:59.861241 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:50:59.861247 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:50:59.861346 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:50:59.861475 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:50:59.862450 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.863398 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.864587 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:50:59.865079 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:50:59.865221 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:50:59.869258 (+ 4037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:57141: BlockingRecv error: recv got EOF from 127.23.131.66:57141 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 22:51:00 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:00 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:00.355445 6667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:00.346350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:43887)
0809 22:51:00.346926 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:00.346943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:00.347086 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:00.347423 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:00.347426 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:00.347949 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:00.348205 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:00.348218 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.349678 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.349683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:00.350660 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:00.350673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.351355 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.351359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:00.351491 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:00.352095 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:00.352113 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:00.355098 (+ 2985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":324,"threads_started":1}
W20260809 22:51:00.355515 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:00.346475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:43887 (local address 127.23.131.126:41037)
0809 22:51:00.346683 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:00.346688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:00.347045 (+ 357us) server_negotiation.cc:407] Connection header received
0809 22:51:00.347214 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:00.347218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:00.347286 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:00.347376 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:00.348363 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.349501 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.350791 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.351190 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.351355 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:00.355336 (+ 3981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:43887: BlockingRecv error: recv got EOF from 127.23.131.67:43887 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 09 22:51:00 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:00 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:00.372198 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:00.364010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:45483)
0809 22:51:00.364490 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:00.364510 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:00.364631 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:00.364963 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:00.364968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:00.365361 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:00.365531 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:00.365539 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.366541 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.366545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:00.367638 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:00.367651 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.368323 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.368326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:00.368441 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:00.369045 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:00.369063 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:00.371888 (+ 2825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":259,"threads_started":1}
W20260809 22:51:00.372372 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:00.364061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:45483 (local address 127.23.131.126:41037)
0809 22:51:00.364325 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:00.364331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:00.364592 (+ 261us) server_negotiation.cc:407] Connection header received
0809 22:51:00.364731 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:00.364734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:00.364796 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:00.364877 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:00.365666 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.366413 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.367762 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.368197 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.368292 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:00.372104 (+ 3812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:45483: BlockingRecv error: recv got EOF from 127.23.131.65:45483 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 22:51:00 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:00 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:00.883360 6671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:00.870337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:39197)
0809 22:51:00.870968 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:00.870985 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:00.871107 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:00.871526 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:00.871529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:00.871951 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:00.872114 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:00.872123 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.873222 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.873226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:00.874202 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:00.874215 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.875000 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.875004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:00.875164 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:00.879566 (+ 4402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:00.879587 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:00.883017 (+ 3430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":357,"threads_started":1}
W20260809 22:51:00.883739 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:00.870443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:39197 (local address 127.23.131.126:41037)
0809 22:51:00.870632 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:00.870636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:00.871062 (+ 426us) server_negotiation.cc:407] Connection header received
0809 22:51:00.871309 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:00.871314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:00.871383 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:00.871474 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:00.872285 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.873075 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.874353 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:00.874826 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:00.874946 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:00.883468 (+ 8522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:39197: BlockingRecv error: recv got EOF from 127.23.131.66:39197 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 22:51:01 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:01 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:01.365409 6673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:01.356565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:46197)
0809 22:51:01.357109 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:01.357126 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:01.357247 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:01.357554 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:01.357557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:01.357957 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:01.358135 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:01.358143 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.359193 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.359197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:01.360291 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:01.360304 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.361111 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.361117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:01.361301 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:01.361924 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:01.361941 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:01.365059 (+ 3118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":295,"threads_started":1}
W20260809 22:51:01.365550 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:01.356654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:46197 (local address 127.23.131.126:41037)
0809 22:51:01.356932 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:01.356938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:01.357213 (+ 275us) server_negotiation.cc:407] Connection header received
0809 22:51:01.357352 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:01.357355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:01.357420 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:01.357504 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:01.358264 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.359052 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.360477 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.360952 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.361095 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:01.365280 (+ 4185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:46197: BlockingRecv error: recv got EOF from 127.23.131.67:46197 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 09 22:51:01 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:01 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:01.385492 6675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:01.373277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:52829)
0809 22:51:01.374460 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:01.374511 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:01.374712 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:01.375291 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:01.375303 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:01.376199 (+ 896us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:01.376497 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:01.376513 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.378083 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.378090 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:01.379501 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:01.379522 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.380507 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.380525 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:01.380757 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:01.381640 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:01.381667 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:01.385221 (+ 3554us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":876,"thread_start_us":283,"threads_started":1}
W20260809 22:51:01.385964 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:01.373352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:52829 (local address 127.23.131.126:41037)
0809 22:51:01.373614 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:01.373622 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:01.374780 (+ 1158us) server_negotiation.cc:407] Connection header received
0809 22:51:01.374878 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:01.374884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:01.375032 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:01.375142 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:01.376806 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.377763 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.379684 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.380187 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.380311 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:01.385511 (+ 5200us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:52829: BlockingRecv error: recv got EOF from 127.23.131.65:52829 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 22:51:01 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:01 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:01.893450 6677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:01.884425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:57961)
0809 22:51:01.885215 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:01.885233 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:01.885355 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:01.885694 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:01.885698 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:01.886338 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:01.886612 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:01.886628 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.887763 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.887767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:01.888697 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:01.888709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.889452 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.889456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:01.889601 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:01.890213 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:01.890230 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:01.893185 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":508,"threads_started":1}
W20260809 22:51:01.893664 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:01.884696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:57961 (local address 127.23.131.126:41037)
0809 22:51:01.884920 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:01.884926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:01.885309 (+ 383us) server_negotiation.cc:407] Connection header received
0809 22:51:01.885491 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:01.885495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:01.885556 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:01.885635 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:01.886806 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.887619 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.888846 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:01.889319 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:01.889420 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:01.893387 (+ 3967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:57961: BlockingRecv error: recv got EOF from 127.23.131.66:57961 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 22:51:02 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:02 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:02.375691 6678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:02.366676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:37771)
0809 22:51:02.367334 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:02.367351 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:02.367472 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:02.367801 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:02.367804 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:02.368293 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:02.368461 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:02.368469 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.369724 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.369728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:02.370890 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:02.370903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.371720 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.371724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:02.371852 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:02.372447 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:02.372465 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:02.375420 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":347,"threads_started":1}
W20260809 22:51:02.375896 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:02.366801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:37771 (local address 127.23.131.126:41037)
0809 22:51:02.367073 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:02.367078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:02.367438 (+ 360us) server_negotiation.cc:407] Connection header received
0809 22:51:02.367584 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:02.367589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:02.367657 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:02.367757 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:02.368647 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.369577 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.371052 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.371589 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.371685 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:02.375642 (+ 3957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:37771: BlockingRecv error: recv got EOF from 127.23.131.67:37771 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 09 22:51:02 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:02 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:02.395067 6679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:02.386526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:52797)
0809 22:51:02.387031 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:02.387054 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:02.387171 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:02.387577 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:02.387581 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:02.387954 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:02.388137 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:02.388164 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.389194 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.389197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:02.390094 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:02.390104 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.390760 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.390764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:02.390884 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:02.391500 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:02.391520 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:02.394845 (+ 3325us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":284,"threads_started":1}
W20260809 22:51:02.395460 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:02.386591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:52797 (local address 127.23.131.126:41037)
0809 22:51:02.386832 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:02.386838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:02.387133 (+ 295us) server_negotiation.cc:407] Connection header received
0809 22:51:02.387382 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:02.387386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:02.387450 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:02.387528 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:02.388293 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.389073 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.390210 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.390623 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.390713 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:02.395074 (+ 4361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:52797: BlockingRecv error: recv got EOF from 127.23.131.65:52797 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 22:51:02 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:02 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:02.903406 6680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:02.894544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:53065)
0809 22:51:02.895148 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:02.895165 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:02.895371 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:02.895727 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:02.895731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:02.896120 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:02.896284 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:02.896292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.897326 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.897333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:02.898737 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:02.898750 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.899554 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.899558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:02.899686 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:02.900283 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:02.900300 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:02.903106 (+ 2806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":345,"threads_started":1}
W20260809 22:51:02.903694 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:02.894638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:53065 (local address 127.23.131.126:41037)
0809 22:51:02.894848 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:02.894853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:02.895293 (+ 440us) server_negotiation.cc:407] Connection header received
0809 22:51:02.895503 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:02.895507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:02.895572 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:02.895662 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:02.896415 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.897170 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.898930 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:02.899411 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:02.899525 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:02.903404 (+ 3879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:53065: BlockingRecv error: recv got EOF from 127.23.131.66:53065 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 22:51:03 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:03 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:03.385673 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:03.376736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:41141)
0809 22:51:03.377343 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:03.377360 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:03.377527 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:03.377877 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:03.377882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:03.378382 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:03.378625 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:03.378638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.380022 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.380027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:03.380994 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:03.381014 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.381775 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.381781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:03.381967 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:03.382551 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:03.382568 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:03.385444 (+ 2876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":365,"threads_started":1}
W20260809 22:51:03.385874 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:03.376869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:41141 (local address 127.23.131.126:41037)
0809 22:51:03.377120 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:03.377128 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:03.377450 (+ 322us) server_negotiation.cc:407] Connection header received
0809 22:51:03.377655 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:03.377660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:03.377737 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:03.377844 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:03.378780 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.379868 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.381144 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.381615 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.381753 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:03.385636 (+ 3883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:41141: BlockingRecv error: recv got EOF from 127.23.131.67:41141 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 22:51:03 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:03 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:03.405333 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:03.396022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:41125)
0809 22:51:03.396640 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:03.396660 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:03.396821 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:03.397198 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:03.397203 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:03.397682 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:03.397860 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:03.397869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.398921 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.398926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:03.400063 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:03.400076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.400781 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.400788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:03.400948 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:03.401571 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:03.401589 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:03.404934 (+ 3345us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":249,"threads_started":1}
W20260809 22:51:03.405428 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:03.396085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:41125 (local address 127.23.131.126:41037)
0809 22:51:03.396245 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:03.396271 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:03.396748 (+ 477us) server_negotiation.cc:407] Connection header received
0809 22:51:03.396993 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:03.396997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:03.397059 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:03.397167 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:03.398016 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.398775 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.400207 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.400619 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.400748 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:03.405189 (+ 4441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:41125: BlockingRecv error: recv got EOF from 127.23.131.65:41125 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 22:51:03 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:03 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:03.914395 6685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:03.904503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:44589)
0809 22:51:03.905174 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:03.905192 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:03.905324 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:03.905726 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:03.905731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:03.906267 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:03.906454 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:03.906463 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.907861 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.907865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:03.909167 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:03.909182 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.910076 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.910081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:03.910198 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:03.910744 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:03.910762 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:03.914111 (+ 3349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":322,"threads_started":1}
W20260809 22:51:03.914789 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:03.904671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:44589 (local address 127.23.131.126:41037)
0809 22:51:03.905025 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:03.905033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:03.905282 (+ 249us) server_negotiation.cc:407] Connection header received
0809 22:51:03.905451 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:03.905457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:03.905528 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:03.905616 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:03.906634 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.907734 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.909337 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:03.909886 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:03.910045 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:03.914346 (+ 4301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:44589: BlockingRecv error: recv got EOF from 127.23.131.66:44589 (error 108)
Metrics: {"server-negotiator.queue_time_us":175}
Aug 09 22:51:04 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:04 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:04.395942 6686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:04.386790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:48473)
0809 22:51:04.387740 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:04.387759 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:04.387927 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:04.388300 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:04.388305 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:04.388806 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:04.388993 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:04.389002 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.390033 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.390040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:04.391008 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:04.391019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.391869 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.391875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:04.392051 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:04.392656 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:04.392673 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:04.395681 (+ 3008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":357,"threads_started":1}
W20260809 22:51:04.396270 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:04.386854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:48473 (local address 127.23.131.126:41037)
0809 22:51:04.387042 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:04.387049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:04.387861 (+ 812us) server_negotiation.cc:407] Connection header received
0809 22:51:04.388066 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:04.388071 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:04.388153 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:04.388253 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:04.389149 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.389876 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.391162 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.391686 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.391832 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:04.395975 (+ 4143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:48473: BlockingRecv error: recv got EOF from 127.23.131.67:48473 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 22:51:04 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:04 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:04.415126 6687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:04.406424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:58363)
0809 22:51:04.406976 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:04.406998 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:04.407117 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:04.407451 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:04.407454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:04.407832 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:04.408004 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:04.408013 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.409158 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.409161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:04.410095 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:04.410106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.410838 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.410845 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:04.411051 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:04.411757 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:04.411775 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:04.414756 (+ 2981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":293,"threads_started":1}
W20260809 22:51:04.415262 6201 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:04.406604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58363 (local address 127.23.131.126:41037)
0809 22:51:04.406837 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:04.406842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:04.407074 (+ 232us) server_negotiation.cc:407] Connection header received
0809 22:51:04.407237 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:04.407248 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:04.407310 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:04.407390 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:04.408127 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.409029 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.410217 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.410647 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.410782 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:04.414961 (+ 4179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:58363: BlockingRecv error: recv got EOF from 127.23.131.65:58363 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 22:51:04 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:04 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:04.930850 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:04.915445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:56971)
0809 22:51:04.916470 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:04.916495 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:04.916670 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:04.917133 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:04.917138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:04.917585 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:04.917745 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:04.917754 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.919088 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.919099 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:04.920086 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:04.920099 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.920884 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.920892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:04.921061 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:04.927017 (+ 5956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:04.927048 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:04.930614 (+ 3566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":845,"thread_start_us":711,"threads_started":1}
W20260809 22:51:04.931172 6691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:04.915592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:56971 (local address 127.23.131.126:41037)
0809 22:51:04.916850 (+ 1258us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:04.916854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:04.916868 (+ 14us) server_negotiation.cc:407] Connection header received
0809 22:51:04.916909 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:04.916912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:04.916975 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:04.917102 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:04.917928 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.918927 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.920237 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:04.920679 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:04.920815 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:04.930826 (+ 10011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:56971: BlockingRecv error: recv got EOF from 127.23.131.66:56971 (error 108)
Metrics: {"server-negotiator.queue_time_us":1140,"thread_start_us":994,"threads_started":1}
Aug 09 22:51:05 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:05 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:05.405365 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:05.396936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:53313)
0809 22:51:05.397510 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:05.397527 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:05.397656 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:05.397950 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:05.397953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:05.398350 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:05.398509 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:05.398518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.399553 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.399557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:05.400510 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:05.400521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.401368 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.401379 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:05.401495 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:05.402182 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:05.402200 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:05.405120 (+ 2920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":307,"threads_started":1}
W20260809 22:51:05.405702 6691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:05.397063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:53313 (local address 127.23.131.126:41037)
0809 22:51:05.397339 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:05.397345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:05.397620 (+ 275us) server_negotiation.cc:407] Connection header received
0809 22:51:05.397745 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:05.397748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:05.397812 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:05.397891 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:05.398649 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.399415 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.400630 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.401150 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.401264 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:05.405338 (+ 4074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:53313: BlockingRecv error: recv got EOF from 127.23.131.67:53313 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 09 22:51:05 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:05 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:05.424348 6693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:05.416037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:50743)
0809 22:51:05.416677 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:05.416698 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:05.416820 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:05.417136 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:05.417139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:05.417520 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:05.417686 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:05.417695 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.418702 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.418705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:05.419725 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:05.419738 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.420389 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.420393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:05.420511 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:05.421087 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:05.421104 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:05.424104 (+ 3000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":353,"threads_started":1}
W20260809 22:51:05.424660 6691 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:05.416211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:50743 (local address 127.23.131.126:41037)
0809 22:51:05.416436 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:05.416440 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:05.416795 (+ 355us) server_negotiation.cc:407] Connection header received
0809 22:51:05.416937 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:05.416941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:05.417002 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:05.417086 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:05.417832 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.418587 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.419846 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.420257 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.420352 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:05.424336 (+ 3984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:50743: BlockingRecv error: recv got EOF from 127.23.131.65:50743 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 22:51:05 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:05 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:05.945405 6694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:05.931814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:44805)
0809 22:51:05.932446 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:05.932464 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:05.932598 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:05.933000 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:05.933003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:05.933429 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:05.933596 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:05.933604 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.934681 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.934685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:05.935747 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:05.935761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.936474 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.936479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:05.936601 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:05.942175 (+ 5574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:05.942194 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:05.945155 (+ 2961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":354,"threads_started":1}
W20260809 22:51:05.945637 6696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:05.931966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:44805 (local address 127.23.131.126:41037)
0809 22:51:05.932506 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:05.932510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:05.932527 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:51:05.932751 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:05.932758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:05.932850 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:05.932942 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:05.933750 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.934558 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.935871 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:05.936326 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:05.936424 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:05.945349 (+ 8925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:44805: BlockingRecv error: recv got EOF from 127.23.131.66:44805 (error 108)
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":297,"threads_started":1}
Aug 09 22:51:06 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:06 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:06.415729 6697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:06.406387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:57581)
0809 22:51:06.407024 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:06.407042 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:06.407253 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:06.407639 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:06.407644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:06.408120 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:06.408295 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:06.408305 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.409381 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.409387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:06.410338 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:06.410350 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.411062 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.411068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:06.411277 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:06.411887 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:06.411909 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:06.415472 (+ 3563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":358,"threads_started":1}
W20260809 22:51:06.415810 6696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:06.406501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:57581 (local address 127.23.131.126:41037)
0809 22:51:06.406773 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:06.406782 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:06.407144 (+ 362us) server_negotiation.cc:407] Connection header received
0809 22:51:06.407390 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:06.407402 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:06.407466 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:06.407579 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:06.408458 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.409235 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.410487 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.410892 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.411024 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:06.415629 (+ 4605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:57581: BlockingRecv error: recv got EOF from 127.23.131.67:57581 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 09 22:51:06 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:06 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:06.434253 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:06.425415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:45195)
0809 22:51:06.426106 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:06.426135 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:06.426273 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:06.426645 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:06.426650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:06.427155 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:06.427364 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:06.427374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.428408 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.428413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:06.429482 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:06.429495 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.430240 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.430246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:06.430411 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:06.430992 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:06.431010 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:06.434022 (+ 3012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":426,"threads_started":1}
W20260809 22:51:06.434473 6696 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:06.425494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:45195 (local address 127.23.131.126:41037)
0809 22:51:06.425662 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:06.425689 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:06.426196 (+ 507us) server_negotiation.cc:407] Connection header received
0809 22:51:06.426415 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:06.426425 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:06.426497 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:06.426617 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:06.427503 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.428271 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.429645 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.430080 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.430217 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:06.434202 (+ 3985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:45195: BlockingRecv error: recv got EOF from 127.23.131.65:45195 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 22:51:06 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:06 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:06.955451 6700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:06.946379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:47635)
0809 22:51:06.946940 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:06.946970 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:06.947082 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:06.947517 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:06.947522 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:06.947974 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:06.948154 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:06.948164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.949306 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.949317 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:06.950269 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:06.950281 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.951029 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.951034 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:06.951249 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:06.952003 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:06.952024 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:06.955108 (+ 3084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":295,"threads_started":1}
W20260809 22:51:06.955655 6701 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:06.946519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:47635 (local address 127.23.131.126:41037)
0809 22:51:06.947027 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:06.947031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:06.947047 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:51:06.947190 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:06.947193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:06.947352 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:06.947463 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:06.948307 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.949154 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.950416 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:06.950851 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:06.950984 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:06.955380 (+ 4396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:47635: BlockingRecv error: recv got EOF from 127.23.131.66:47635 (error 108)
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":268,"threads_started":1}
Aug 09 22:51:07 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:07 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:07.425335 6702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:07.416819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:48505)
0809 22:51:07.417422 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:07.417443 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:07.417599 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:07.417981 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:07.417985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:07.418382 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:07.418537 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:07.418546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.419623 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.419628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:07.420637 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:07.420651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.421290 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.421295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:07.421412 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:07.422005 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:07.422024 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:07.425094 (+ 3070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":336,"threads_started":1}
W20260809 22:51:07.425550 6701 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:07.416978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:48505 (local address 127.23.131.126:41037)
0809 22:51:07.417264 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:07.417270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:07.417580 (+ 310us) server_negotiation.cc:407] Connection header received
0809 22:51:07.417726 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:07.417731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:07.417826 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:07.417924 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:07.418676 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.419462 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.420767 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.421158 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.421250 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:07.425297 (+ 4047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:48505: BlockingRecv error: recv got EOF from 127.23.131.67:48505 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
Aug 09 22:51:07 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:07 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:07.444187 6703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:07.435154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:40089)
0809 22:51:07.435721 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:07.435741 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:07.435860 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:07.436216 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:07.436220 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:07.436646 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:07.436830 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:07.436839 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.437931 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.437936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:07.438855 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:07.438867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.439728 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.439733 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:07.439872 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:07.440602 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:07.440630 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:07.443936 (+ 3306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":307,"threads_started":1}
W20260809 22:51:07.444432 6701 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:07.435303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:40089 (local address 127.23.131.126:41037)
0809 22:51:07.435540 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:07.435547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:07.435828 (+ 281us) server_negotiation.cc:407] Connection header received
0809 22:51:07.435963 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:07.435967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:07.436078 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:07.436171 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:07.436971 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.437769 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.439053 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.439561 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.439680 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:07.444173 (+ 4493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:40089: BlockingRecv error: recv got EOF from 127.23.131.65:40089 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 22:51:07 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:07 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:07.965335 6705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:07.956438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:60023)
0809 22:51:07.957044 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:07.957064 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:07.957186 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:07.957513 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:07.957516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:07.957933 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:07.958116 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:07.958125 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.959394 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.959400 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:07.960310 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:07.960322 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.961098 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.961104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:07.961301 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:07.961995 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:07.962014 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:07.964978 (+ 2964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":352,"threads_started":1}
W20260809 22:51:07.965479 6706 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:07.956558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:60023 (local address 127.23.131.126:41037)
0809 22:51:07.957054 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:07.957059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:07.957141 (+ 82us) server_negotiation.cc:407] Connection header received
0809 22:51:07.957297 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:07.957301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:07.957364 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:07.957468 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:07.958286 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.959257 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.960465 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:07.960913 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:07.961073 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:07.965202 (+ 4129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:60023: BlockingRecv error: recv got EOF from 127.23.131.66:60023 (error 108)
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":287,"threads_started":1}
Aug 09 22:51:08 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:08 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:08.435524 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:08.426346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:33453)
0809 22:51:08.427007 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:08.427026 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:08.427151 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:08.427585 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:08.427588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:08.428008 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:08.428198 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:08.428207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.429283 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.429288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:08.430274 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:08.430287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.431028 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.431032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:08.431162 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:08.431985 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:08.432018 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:08.435270 (+ 3252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":353,"threads_started":1}
W20260809 22:51:08.435796 6706 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:08.426564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:33453 (local address 127.23.131.126:41037)
0809 22:51:08.426784 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:08.426791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:08.427184 (+ 393us) server_negotiation.cc:407] Connection header received
0809 22:51:08.427296 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:08.427301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:08.427379 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:08.427491 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:08.428382 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.429147 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.430434 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.430882 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.430996 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:08.435514 (+ 4518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:33453: BlockingRecv error: recv got EOF from 127.23.131.67:33453 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 22:51:08 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:08 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:08.453682 6708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:08.445247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:36313)
0809 22:51:08.445819 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:08.445842 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:08.445956 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:08.446299 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:08.446302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:08.446724 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:08.446880 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:08.446888 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.448056 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.448060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:08.449049 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:08.449061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.449857 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.449861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:08.449988 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:08.450603 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:08.450621 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:08.453447 (+ 2826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":320,"threads_started":1}
W20260809 22:51:08.453943 6706 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:08.445268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:36313 (local address 127.23.131.126:41037)
0809 22:51:08.445415 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:08.445419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:08.445947 (+ 528us) server_negotiation.cc:407] Connection header received
0809 22:51:08.446054 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:08.446058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:08.446153 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:08.446237 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:08.447026 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.447909 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.449177 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.449720 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.449816 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:08.453655 (+ 3839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:36313: BlockingRecv error: recv got EOF from 127.23.131.65:36313 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 22:51:08 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:08 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:08.975972 6710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:08.966429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:33963)
0809 22:51:08.967032 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:08.967053 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:08.967177 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:08.967612 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:08.967615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:08.968018 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:08.968175 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:08.968183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.969497 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.969503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:08.970736 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:08.970749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.971595 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.971601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:08.971795 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:08.972463 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:08.972482 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:08.975600 (+ 3118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":355,"threads_started":1}
W20260809 22:51:08.976099 6711 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:08.966484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:33963 (local address 127.23.131.126:41037)
0809 22:51:08.967067 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:08.967072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:08.967113 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:51:08.967352 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:08.967356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:08.967457 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:08.967559 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:08.968318 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.969192 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.970897 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:08.971429 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:08.971568 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:08.975821 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:33963: BlockingRecv error: recv got EOF from 127.23.131.66:33963 (error 108)
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":336,"threads_started":1}
Aug 09 22:51:09 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:09 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:09.446461 6712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:09.436717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:53497)
0809 22:51:09.437343 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:09.437361 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:09.437507 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:09.437877 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:09.437881 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:09.438346 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:09.438533 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:09.438543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.439845 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.439850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:09.440852 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:09.440866 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.441679 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.441683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:09.441825 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:09.442667 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:09.442687 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:09.446136 (+ 3449us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":365,"threads_started":1}
W20260809 22:51:09.446532 6711 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:09.436869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:53497 (local address 127.23.131.126:41037)
0809 22:51:09.437127 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:09.437131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:09.437489 (+ 358us) server_negotiation.cc:407] Connection header received
0809 22:51:09.437625 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:09.437629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:09.437711 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:09.437821 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:09.438718 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.439657 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.441028 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.441499 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.441620 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:09.446333 (+ 4713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:53497: BlockingRecv error: recv got EOF from 127.23.131.67:53497 (error 108)
Metrics: {"server-negotiator.queue_time_us":131}
Aug 09 22:51:09 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:09 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:09.463586 6715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:09.454697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:51861)
0809 22:51:09.455335 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:09.455355 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:09.455471 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:09.455865 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:09.455869 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:09.456320 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:09.456529 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:09.456539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.457847 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.457851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:09.458798 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:09.458810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.459602 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.459607 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:09.459726 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:09.460313 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:09.460331 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:09.463338 (+ 3007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":342,"threads_started":1}
W20260809 22:51:09.463811 6711 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:09.454826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:51861 (local address 127.23.131.126:41037)
0809 22:51:09.455056 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:09.455061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:09.455438 (+ 377us) server_negotiation.cc:407] Connection header received
0809 22:51:09.455609 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:09.455614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:09.455692 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:09.455818 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:09.456675 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.457717 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.458930 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.459430 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.459529 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:09.463541 (+ 4012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:51861: BlockingRecv error: recv got EOF from 127.23.131.65:51861 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 22:51:09 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:09 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:09.986197 6718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:09.977016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:39751)
0809 22:51:09.977617 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:09.977634 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:09.977747 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:09.978169 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:09.978173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:09.978615 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:09.978781 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:09.978790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.979983 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.980007 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:09.980942 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:09.980955 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.981674 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.981678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:09.981800 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:09.982597 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:09.982614 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:09.985954 (+ 3340us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":309,"threads_started":1}
W20260809 22:51:09.986387 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:09.977212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:39751 (local address 127.23.131.126:41037)
0809 22:51:09.977679 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:09.977684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:09.977701 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:51:09.977855 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:09.977858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:09.978024 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:09.978120 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:09.978948 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.979847 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.981099 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:09.981511 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:09.981610 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:09.986125 (+ 4515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:39751: BlockingRecv error: recv got EOF from 127.23.131.66:39751 (error 108)
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":255,"threads_started":1}
Aug 09 22:51:10 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:10 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:10.457342 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:10.447660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:37831)
0809 22:51:10.448318 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:10.448337 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:10.448528 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:10.448913 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:10.448918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:10.449485 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:10.449665 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:10.449676 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.450829 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.450836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:10.451938 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:10.451952 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.452799 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.452807 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:10.453004 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:10.453711 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:10.453732 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:10.456940 (+ 3208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":312,"threads_started":1}
W20260809 22:51:10.457449 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:10.447723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:37831 (local address 127.23.131.126:41037)
0809 22:51:10.448005 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:10.448015 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:10.448439 (+ 424us) server_negotiation.cc:407] Connection header received
0809 22:51:10.448685 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:10.448689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:10.448757 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:10.448879 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:10.449854 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.450660 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.452109 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.452576 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.452754 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:10.457174 (+ 4420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:37831: BlockingRecv error: recv got EOF from 127.23.131.67:37831 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 22:51:10 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:10 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:10.473946 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:10.464657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:50109)
0809 22:51:10.465221 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:10.465248 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:10.465435 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:10.465801 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:10.465805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:10.466245 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:10.466429 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:10.466439 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.467582 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.467586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:10.468498 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:10.468510 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.469230 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.469236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:10.469420 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:10.470112 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:10.470131 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:10.473593 (+ 3462us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":321,"threads_started":1}
W20260809 22:51:10.474097 6719 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:10.464743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:50109 (local address 127.23.131.126:41037)
0809 22:51:10.465050 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:10.465056 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:10.465357 (+ 301us) server_negotiation.cc:407] Connection header received
0809 22:51:10.465593 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:10.465597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:10.465661 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:10.465767 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:10.466582 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.467431 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.468651 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.469070 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.469214 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:10.473817 (+ 4603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:50109: BlockingRecv error: recv got EOF from 127.23.131.65:50109 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
Aug 09 22:51:10 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:10 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:11.001541 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:10.987317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:54175)
0809 22:51:10.987895 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:10.987913 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:10.988060 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:10.988429 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:10.988432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:10.988816 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:10.989033 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:10.989043 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.990111 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.990115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:10.991046 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:10.991059 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.992150 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.992156 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:10.992322 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:10.998083 (+ 5761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:10.998104 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:11.001186 (+ 3082us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":337,"threads_started":1}
W20260809 22:51:11.001721 6724 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:10.987445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:54175 (local address 127.23.131.126:41037)
0809 22:51:10.987983 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:10.987987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:10.988008 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:51:10.988178 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:10.988182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:10.988273 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:10.988381 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:10.989201 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.989974 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.991195 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:10.991961 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:10.992074 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:11.001422 (+ 9348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:54175: BlockingRecv error: recv got EOF from 127.23.131.66:54175 (error 108)
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":290,"threads_started":1}
Aug 09 22:51:11 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:11 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.67@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:11.467461 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:11.458494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.67:45201)
0809 22:51:11.458987 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:11.459004 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:11.459128 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:11.459499 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:11.459502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:11.459916 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:11.460127 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:11.460136 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.461208 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.461212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:11.462193 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:11.462209 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.463101 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.463107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:11.463334 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:11.464053 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:11.464072 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:11.467067 (+ 2995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":258,"threads_started":1}
W20260809 22:51:11.467523 6724 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:11.458648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:45201 (local address 127.23.131.126:41037)
0809 22:51:11.458896 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:11.458903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:11.459091 (+ 188us) server_negotiation.cc:407] Connection header received
0809 22:51:11.459283 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:11.459288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:11.459365 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:11.459447 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:11.460259 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.461011 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.462334 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.462931 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.463074 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:11.467298 (+ 4224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.67:45201: BlockingRecv error: recv got EOF from 127.23.131.67:45201 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 09 22:51:11 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:11 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.65@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:11.484064 6726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:11.475416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.65:57003)
0809 22:51:11.476025 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:11.476048 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:11.476171 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:11.476456 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:11.476459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:11.476851 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:11.477022 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:11.477030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.478055 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.478060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:11.479123 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:11.479136 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.479848 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.479852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:11.480017 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:11.480620 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:11.480637 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:11.483759 (+ 3122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":305,"threads_started":1}
W20260809 22:51:11.484225 6724 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:11.475481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:57003 (local address 127.23.131.126:41037)
0809 22:51:11.475703 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:11.475712 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:11.476110 (+ 398us) server_negotiation.cc:407] Connection header received
0809 22:51:11.476262 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:11.476265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:11.476329 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:11.476403 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:11.477141 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.477879 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.479293 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:11.479714 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:11.479805 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:11.483974 (+ 4169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.65:57003: BlockingRecv error: recv got EOF from 127.23.131.65:57003 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 22:51:12 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 22:51:12 dist-test-slave-92m1 krb5kdc[4995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.131.66@KRBTEST.COM for oryx/127.23.131.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 22:51:12.014453 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:12.003080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41037 (local address 127.23.131.66:36513)
0809 22:51:12.003964 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:12.003997 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:12.004210 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:12.005214 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:12.005224 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:12.006412 (+ 1188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:12.006652 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:12.006669 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.008104 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.008108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:12.009126 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:12.009142 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.009930 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.009934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:12.010078 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:12.010826 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:12.010847 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:12.014165 (+ 3318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.131.126:41037: Server oryx/127.23.131.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":402,"threads_started":1}
W20260809 22:51:12.014810 6731 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:12.003336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:36513 (local address 127.23.131.126:41037)
0809 22:51:12.004353 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:12.004362 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:12.004388 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:51:12.004482 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:12.004487 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:12.004637 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:12.004800 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:12.006874 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.007872 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.009287 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.009755 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.009859 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:12.014462 (+ 4603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.131.66:36513: BlockingRecv error: recv got EOF from 127.23.131.66:36513 (error 108)
Metrics: {"server-negotiator.queue_time_us":824,"thread_start_us":605,"threads_started":1}
I20260809 22:51:12.291733 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5931
I20260809 22:51:12.305416 6737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:12.293099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.23.131.65:42375)
0809 22:51:12.293816 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:12.293824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:12.293856 (+ 32us) server_negotiation.cc:407] Connection header received
0809 22:51:12.293924 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:12.293930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:12.294149 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:12.294314 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:12.295918 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.297091 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.298460 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.299065 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.299181 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:12.301972 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:12.301989 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:12.302004 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:12.302042 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:12.304851 (+ 2809us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.131.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 22:51:12.305166 (+ 315us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53508: Request ticket server kudu/127.23.131.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":383,"threads_started":1}
W20260809 22:51:12.305577 6737 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53508: Request ticket server kudu/127.23.131.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 22:51:12.305727 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5931: Not authorized: Client connection negotiation failed: client connection to 127.23.131.65:42375: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.131.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 22:51:12.305994 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 5931
I20260809 22:51:12.338079 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 6203
I20260809 22:51:12.351400 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:12.339377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.23.131.66:39107)
0809 22:51:12.340062 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:12.340070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:12.340103 (+ 33us) server_negotiation.cc:407] Connection header received
0809 22:51:12.340167 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:12.340173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:12.340402 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:12.340568 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:12.341940 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.342982 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.344375 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.344943 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.345040 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:12.347726 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:12.347735 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:12.347749 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:12.347785 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:12.350657 (+ 2872us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.131.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 22:51:12.350928 (+ 271us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37394: Request ticket server kudu/127.23.131.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":363,"threads_started":1}
W20260809 22:51:12.351380 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 6203: Not authorized: Client connection negotiation failed: client connection to 127.23.131.66:39107: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.131.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 22:51:12.351550 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 6203
W20260809 22:51:12.351536 6738 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37394: Request ticket server kudu/127.23.131.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 22:51:12.378427 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 6426
I20260809 22:51:12.391211 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:12.379692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43348 (local address 127.23.131.67:36307)
0809 22:51:12.380315 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:12.380323 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:12.380350 (+ 27us) server_negotiation.cc:407] Connection header received
0809 22:51:12.380412 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:12.380418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:12.380641 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:12.380799 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:12.382241 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.383455 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.384624 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:12.385185 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:12.385288 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:12.388208 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:12.388216 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:12.388231 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:12.388273 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:12.390649 (+ 2376us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.131.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 22:51:12.390913 (+ 264us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43348: Request ticket server kudu/127.23.131.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":307,"threads_started":1}
W20260809 22:51:12.391355 6739 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43348: Request ticket server kudu/127.23.131.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 22:51:12.391395 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 6426: Not authorized: Client connection negotiation failed: client connection to 127.23.131.67:36307: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.131.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 22:51:12.391605 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 6426
I20260809 22:51:12.423125 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 5812
I20260809 22:51:12.424695 5919 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:12.549383 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 5812
2026-08-09T22:51:12Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22045 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T22:51:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:51:12Z Disabled control of system clock
I20260809 22:51:12.665336 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:35965
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:35965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 22:51:13.029506 6746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:13.029856 6746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:13.029963 6746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:13.037874 6746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:51:13.038021 6746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:13.038074 6746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:13.038136 6746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:51:13.038179 6746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:51:13.048254 6746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:35965
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:35965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:13.049621 6746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:13.051486 6746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:13.064119 6755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:13.064033 6756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:13.064252 6761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:13.064823 6746 server_base.cc:1034] running on GCE node
I20260809 22:51:13.065714 6746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:13.067313 6746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:13.068557 6746 hybrid_clock.cc:648] HybridClock initialized: now 1786315873068510 us; error 55 us; skew 500 ppm
I20260809 22:51:13.068923 6746 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:13.071374 6746 webserver.cc:460] Webserver started at http://127.23.131.126:45463/ using document root <none> and password file <none>
I20260809 22:51:13.072099 6746 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:13.072242 6746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:13.072604 6746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:13.075721 6746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c716c5093cc94b21946ac429b3e6f0be"
format_stamp: "Formatted at 2026-08-09 22:51:13 on dist-test-slave-92m1"
server_key: "771a7c463c7f2f5337f7cded308d5201"
server_key_iv: "9f4f2217361003a259f0d2d19064978e"
server_key_version: "encryptionkey@0"
I20260809 22:51:13.076602 6746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c716c5093cc94b21946ac429b3e6f0be"
format_stamp: "Formatted at 2026-08-09 22:51:13 on dist-test-slave-92m1"
server_key: "771a7c463c7f2f5337f7cded308d5201"
server_key_iv: "9f4f2217361003a259f0d2d19064978e"
server_key_version: "encryptionkey@0"
I20260809 22:51:13.082296 6746 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:51:13.086269 6767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:13.087805 6746 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:51:13.088009 6746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c716c5093cc94b21946ac429b3e6f0be"
format_stamp: "Formatted at 2026-08-09 22:51:13 on dist-test-slave-92m1"
server_key: "771a7c463c7f2f5337f7cded308d5201"
server_key_iv: "9f4f2217361003a259f0d2d19064978e"
server_key_version: "encryptionkey@0"
I20260809 22:51:13.088259 6746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:13.124133 6746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:13.125097 6746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:13.125443 6746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:13.146036 6746 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:35965
I20260809 22:51:13.146059 6850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:35965 every 8 connection(s)
I20260809 22:51:13.147509 6746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:51:13.150424 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 6746
I20260809 22:51:13.150642 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:51:13.151546 24077 external_mini_cluster.cc:1428] Setting key 5d30566c165505791ddde7c71aa7782b
I20260809 22:51:13.151983 6851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:51:13.166103 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:13.153621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49790 (local address 127.23.131.126:35965)
0809 22:51:13.154655 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:13.154666 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:13.154710 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:51:13.156390 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:13.156412 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:13.156912 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:13.157251 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:13.157964 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:13.159388 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:13.161324 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:13.162032 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:13.162167 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:13.163526 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:13.163533 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:13.163547 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:13.164139 (+ 592us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:13.164228 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:13.164251 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:13.164348 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:13.164744 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 22:51:13.165115 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":380,"threads_started":1}
I20260809 22:51:13.167528 6851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be: Bootstrap starting.
I20260809 22:51:13.171411 6851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be: Neither blocks nor log segments found. Creating new log.
I20260809 22:51:13.172535 6851 log.cc:824] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be: Log is configured to *not* fsync() on all Append() calls
I20260809 22:51:13.175460 6851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be: No bootstrap required, opened a new log
I20260809 22:51:13.183395 6851 raft_consensus.cc:348] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c716c5093cc94b21946ac429b3e6f0be" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35965 } }
I20260809 22:51:13.183775 6851 raft_consensus.cc:374] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:51:13.183856 6851 raft_consensus.cc:729] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716c5093cc94b21946ac429b3e6f0be, State: Initialized, Role: FOLLOWER
I20260809 22:51:13.184466 6851 consensus_queue.cc:260] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c716c5093cc94b21946ac429b3e6f0be" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35965 } }
I20260809 22:51:13.184674 6851 raft_consensus.cc:388] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:51:13.184779 6851 raft_consensus.cc:482] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:51:13.184908 6851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:51:13.187501 6851 raft_consensus.cc:504] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c716c5093cc94b21946ac429b3e6f0be" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35965 } }
I20260809 22:51:13.187995 6851 leader_election.cc:302] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c716c5093cc94b21946ac429b3e6f0be; no voters:
I20260809 22:51:13.188570 6851 leader_election.cc:288] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:51:13.188761 6857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:51:13.189541 6857 raft_consensus.cc:686] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [term 1 LEADER]: Becoming Leader. State: Replica: c716c5093cc94b21946ac429b3e6f0be, State: Running, Role: LEADER
I20260809 22:51:13.190135 6857 consensus_queue.cc:237] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c716c5093cc94b21946ac429b3e6f0be" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35965 } }
I20260809 22:51:13.190766 6851 sys_catalog.cc:564] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:51:13.193518 6858 sys_catalog.cc:455] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c716c5093cc94b21946ac429b3e6f0be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c716c5093cc94b21946ac429b3e6f0be" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35965 } } }
I20260809 22:51:13.193601 6861 sys_catalog.cc:455] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [sys.catalog]: SysCatalogTable state changed. Reason: New leader c716c5093cc94b21946ac429b3e6f0be. Latest consensus state: current_term: 1 leader_uuid: "c716c5093cc94b21946ac429b3e6f0be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c716c5093cc94b21946ac429b3e6f0be" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35965 } } }
I20260809 22:51:13.193964 6858 sys_catalog.cc:458] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [sys.catalog]: This master's current role is: LEADER
I20260809 22:51:13.194024 6861 sys_catalog.cc:458] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be [sys.catalog]: This master's current role is: LEADER
I20260809 22:51:13.199839 6869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:51:13.205524 6869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:51:13.215636 6869 catalog_manager.cc:1347] Generated new cluster ID: fb53653bf6884af6874567bed1aa9059
I20260809 22:51:13.215783 6869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:51:13.239848 6869 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:51:13.241353 6869 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:51:13.253278 6869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c716c5093cc94b21946ac429b3e6f0be: Generated new TSK 0
I20260809 22:51:13.254184 6869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:51:13.261562 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35965
--builtin_ntp_servers=127.23.131.84:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 22:51:13.646677 6886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:13.646982 6886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:13.647080 6886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:13.654565 6886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:13.654686 6886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:13.654794 6886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:51:13.664407 6886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:13.665755 6886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:13.667600 6886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:13.681311 6898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:13.681378 6899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:13.681391 6901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:13.682075 6886 server_base.cc:1034] running on GCE node
I20260809 22:51:13.682746 6886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:13.683816 6886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:13.685063 6886 hybrid_clock.cc:648] HybridClock initialized: now 1786315873685010 us; error 46 us; skew 500 ppm
I20260809 22:51:13.685410 6886 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:13.687959 6886 webserver.cc:460] Webserver started at http://127.23.131.65:37983/ using document root <none> and password file <none>
I20260809 22:51:13.688728 6886 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:13.688885 6886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:13.689239 6886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:13.692438 6886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "7ff3da4bd9e34b30a2dd3dd23d1a1390"
format_stamp: "Formatted at 2026-08-09 22:51:13 on dist-test-slave-92m1"
server_key: "1382333a0220aca16fede7604ddbe974"
server_key_iv: "d6d21241c9bc1c7c0360743e18738e21"
server_key_version: "encryptionkey@0"
I20260809 22:51:13.693439 6886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "7ff3da4bd9e34b30a2dd3dd23d1a1390"
format_stamp: "Formatted at 2026-08-09 22:51:13 on dist-test-slave-92m1"
server_key: "1382333a0220aca16fede7604ddbe974"
server_key_iv: "d6d21241c9bc1c7c0360743e18738e21"
server_key_version: "encryptionkey@0"
I20260809 22:51:13.698864 6886 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:51:13.702708 6907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:13.704283 6886 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:51:13.704487 6886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "7ff3da4bd9e34b30a2dd3dd23d1a1390"
format_stamp: "Formatted at 2026-08-09 22:51:13 on dist-test-slave-92m1"
server_key: "1382333a0220aca16fede7604ddbe974"
server_key_iv: "d6d21241c9bc1c7c0360743e18738e21"
server_key_version: "encryptionkey@0"
I20260809 22:51:13.704735 6886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:13.721491 6886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:13.722466 6886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:13.722808 6886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:13.723917 6886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:13.725520 6886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:13.725660 6886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:13.725792 6886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:13.725884 6886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:13.762128 6886 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:35631
I20260809 22:51:13.762198 7073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:35631 every 8 connection(s)
I20260809 22:51:13.763631 6886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:51:13.773356 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 6886
I20260809 22:51:13.773587 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:51:13.774447 24077 external_mini_cluster.cc:1428] Setting key 39a81910280a868b45c7cd4a67f1c35e
I20260809 22:51:13.777333 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:13.766312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:44195 (local address 127.23.131.126:35965)
0809 22:51:13.766809 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:13.766813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:13.767951 (+ 1138us) server_negotiation.cc:407] Connection header received
0809 22:51:13.769821 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:13.769827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:13.769923 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:13.770060 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:13.771225 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:13.771990 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:13.774255 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:13.774765 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:13.774910 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:13.776447 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:13.776452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:13.776455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:13.776474 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:13.776521 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:13.776534 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:13.776637 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:13.776872 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 22:51:13.776970 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":283,"threads_started":1}
I20260809 22:51:13.777356 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35965
--builtin_ntp_servers=127.23.131.84:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 22:51:13.778491 7081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:13.766789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:35965 (local address 127.23.131.65:44195)
0809 22:51:13.767775 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:13.767819 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:13.769522 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:13.770311 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:13.770320 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:13.770415 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:13.771017 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:13.771035 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:13.772166 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:13.772175 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:13.774057 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:13.774076 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:13.775039 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:13.775048 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:13.775349 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:13.776097 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:51:13.776100 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:13.776143 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:51:13.776226 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:13.776637 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:13.776652 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:13.776663 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 22:51:13.776860 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 22:51:13.777284 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":373,"threads_started":1}
I20260809 22:51:13.780285 7074 heartbeater.cc:347] Connected to a master server at 127.23.131.126:35965
I20260809 22:51:13.780572 7074 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:13.781314 7074 heartbeater.cc:511] Master 127.23.131.126:35965 requested a full tablet report, sending...
I20260809 22:51:13.783739 6793 ts_manager.cc:194] Registered new tserver with Master: 7ff3da4bd9e34b30a2dd3dd23d1a1390 (127.23.131.65:35631)
I20260809 22:51:13.785929 6793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.65:44195
W20260809 22:51:14.140125 7083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:14.140435 7083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:14.140607 7083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:14.148388 7083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:14.148504 7083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:14.148696 7083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:51:14.158236 7083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:14.159571 7083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:14.161391 7083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:14.175177 7094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:14.175338 7092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:14.175304 7098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:14.176038 7083 server_base.cc:1034] running on GCE node
I20260809 22:51:14.176781 7083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:14.177806 7083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:14.179054 7083 hybrid_clock.cc:648] HybridClock initialized: now 1786315874179009 us; error 62 us; skew 500 ppm
I20260809 22:51:14.179430 7083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:14.181803 7083 webserver.cc:460] Webserver started at http://127.23.131.66:44149/ using document root <none> and password file <none>
I20260809 22:51:14.182574 7083 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:14.182718 7083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:14.183090 7083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:14.186216 7083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "e8fb518215564e96a540915b970c3f86"
format_stamp: "Formatted at 2026-08-09 22:51:14 on dist-test-slave-92m1"
server_key: "d3d14166ebf047dd1dd5b38e6a7f1d55"
server_key_iv: "44d2cb80e8655689c490009bb892b4f9"
server_key_version: "encryptionkey@0"
I20260809 22:51:14.187122 7083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "e8fb518215564e96a540915b970c3f86"
format_stamp: "Formatted at 2026-08-09 22:51:14 on dist-test-slave-92m1"
server_key: "d3d14166ebf047dd1dd5b38e6a7f1d55"
server_key_iv: "44d2cb80e8655689c490009bb892b4f9"
server_key_version: "encryptionkey@0"
I20260809 22:51:14.193308 7083 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 22:51:14.197070 7108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:14.198515 7083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:51:14.198722 7083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "e8fb518215564e96a540915b970c3f86"
format_stamp: "Formatted at 2026-08-09 22:51:14 on dist-test-slave-92m1"
server_key: "d3d14166ebf047dd1dd5b38e6a7f1d55"
server_key_iv: "44d2cb80e8655689c490009bb892b4f9"
server_key_version: "encryptionkey@0"
I20260809 22:51:14.198957 7083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:14.213572 7083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:14.214542 7083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:14.214883 7083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:14.216064 7083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:14.217713 7083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:14.217847 7083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:14.217993 7083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:14.218088 7083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:14.258827 7083 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:41265
I20260809 22:51:14.258884 7301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:41265 every 8 connection(s)
I20260809 22:51:14.260435 7083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:51:14.264173 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 7083
I20260809 22:51:14.264413 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:51:14.265017 24077 external_mini_cluster.cc:1428] Setting key f9fb6b4cc1da6df737ff99a44055377f
I20260809 22:51:14.268141 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35965
--builtin_ntp_servers=127.23.131.84:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 22:51:14.274721 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:14.263273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:36617 (local address 127.23.131.126:35965)
0809 22:51:14.263473 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:14.263493 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:14.265219 (+ 1726us) server_negotiation.cc:407] Connection header received
0809 22:51:14.267398 (+ 2179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:14.267403 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:14.267494 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:14.267613 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:14.268876 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.269617 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.271408 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.272148 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.272313 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:14.273780 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:14.273788 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:14.273796 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:14.273823 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:14.273865 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:14.273884 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:14.273982 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:14.274204 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 22:51:14.274325 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:51:14.275844 7305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:14.263853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:35965 (local address 127.23.131.66:36617)
0809 22:51:14.265016 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:14.265060 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:14.267030 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:14.267866 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:14.267875 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:14.267970 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:14.268690 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:14.268710 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.269810 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.269814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:14.271167 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:14.271181 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.272377 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.272381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:14.272608 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:14.273426 (+ 818us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:51:14.273429 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:14.273473 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:51:14.273573 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:14.273988 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:14.273997 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:14.274003 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:51:14.274162 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 22:51:14.274501 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":408,"threads_started":1}
I20260809 22:51:14.277379 7302 heartbeater.cc:347] Connected to a master server at 127.23.131.126:35965
I20260809 22:51:14.277720 7302 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:14.278535 7302 heartbeater.cc:511] Master 127.23.131.126:35965 requested a full tablet report, sending...
I20260809 22:51:14.280267 6793 ts_manager.cc:194] Registered new tserver with Master: e8fb518215564e96a540915b970c3f86 (127.23.131.66:41265)
I20260809 22:51:14.281123 6793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.66:36617
W20260809 22:51:14.629817 7306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:14.630131 7306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:14.630223 7306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:14.637758 7306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:14.637859 7306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:14.637964 7306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:51:14.648005 7306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:14.649287 7306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:14.651055 7306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:14.664713 7311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:14.664904 7313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:14.665019 7315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:14.665966 7306 server_base.cc:1034] running on GCE node
I20260809 22:51:14.666656 7306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:14.667780 7306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:14.669032 7306 hybrid_clock.cc:648] HybridClock initialized: now 1786315874668974 us; error 52 us; skew 500 ppm
I20260809 22:51:14.669389 7306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:14.671880 7306 webserver.cc:460] Webserver started at http://127.23.131.67:37745/ using document root <none> and password file <none>
I20260809 22:51:14.672693 7306 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:14.672837 7306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:14.673194 7306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:14.676201 7306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "a3f9478afb994ea6b22d6d91a338da1e"
format_stamp: "Formatted at 2026-08-09 22:51:14 on dist-test-slave-92m1"
server_key: "adea5dafb929321c0d3bc6748fe16294"
server_key_iv: "2ab7edbeb2d4ec5961c0d2870cd9cec8"
server_key_version: "encryptionkey@0"
I20260809 22:51:14.677048 7306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "a3f9478afb994ea6b22d6d91a338da1e"
format_stamp: "Formatted at 2026-08-09 22:51:14 on dist-test-slave-92m1"
server_key: "adea5dafb929321c0d3bc6748fe16294"
server_key_iv: "2ab7edbeb2d4ec5961c0d2870cd9cec8"
server_key_version: "encryptionkey@0"
I20260809 22:51:14.682415 7306 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:51:14.685938 7327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:14.687454 7306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:51:14.687644 7306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "a3f9478afb994ea6b22d6d91a338da1e"
format_stamp: "Formatted at 2026-08-09 22:51:14 on dist-test-slave-92m1"
server_key: "adea5dafb929321c0d3bc6748fe16294"
server_key_iv: "2ab7edbeb2d4ec5961c0d2870cd9cec8"
server_key_version: "encryptionkey@0"
I20260809 22:51:14.687876 7306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:14.714603 7306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:14.715682 7306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:14.716050 7306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:14.717458 7306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:14.719384 7306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:14.719529 7306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:14.719703 7306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:14.719806 7306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:14.759541 7306 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:33307
I20260809 22:51:14.759611 7505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:33307 every 8 connection(s)
I20260809 22:51:14.761051 7306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:51:14.764926 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 7306
I20260809 22:51:14.765115 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:51:14.765740 24077 external_mini_cluster.cc:1428] Setting key 87c07785930318362711ec5ea5cb48be
I20260809 22:51:14.775784 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:14.764292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:52961 (local address 127.23.131.126:35965)
0809 22:51:14.764544 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:14.764551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:14.766517 (+ 1966us) server_negotiation.cc:407] Connection header received
0809 22:51:14.769143 (+ 2626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:14.769149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:14.769239 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:14.769400 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:14.770614 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.771457 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.773123 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.773538 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.773634 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:14.774997 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:14.775002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:14.775005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:14.775026 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:14.775060 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:14.775072 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:14.775149 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:14.775436 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 22:51:14.775526 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 22:51:14.776855 7510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:14.764882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:35965 (local address 127.23.131.67:52961)
0809 22:51:14.766290 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:14.766355 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:14.768767 (+ 2412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:14.769678 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:14.769688 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:14.769794 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:14.770438 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:14.770458 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.771627 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.771631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:14.772978 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:14.772993 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.773747 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.773752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:14.773962 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:14.774664 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:51:14.774667 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:14.774710 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:51:14.774800 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:14.775167 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:14.775176 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:14.775182 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:51:14.775409 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 22:51:14.775745 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":510,"threads_started":1}
I20260809 22:51:14.778432 7506 heartbeater.cc:347] Connected to a master server at 127.23.131.126:35965
I20260809 22:51:14.778797 7506 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:14.779817 7506 heartbeater.cc:511] Master 127.23.131.126:35965 requested a full tablet report, sending...
I20260809 22:51:14.781615 6793 ts_manager.cc:194] Registered new tserver with Master: a3f9478afb994ea6b22d6d91a338da1e (127.23.131.67:33307)
I20260809 22:51:14.782407 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:51:14.782693 6793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.67:52961
I20260809 22:51:14.789345 7074 heartbeater.cc:503] Master 127.23.131.126:35965 was elected leader, sending a full tablet report...
W20260809 22:51:14.790098 7076 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:14.788073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58460 (local address 127.23.131.126:35965)
0809 22:51:14.788338 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:14.788349 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:14.788841 (+ 492us) server_negotiation.cc:407] Connection header received
0809 22:51:14.789013 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:14.789022 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:14.789122 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:14.789244 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:14.789768 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58460: BlockingRecv error: recv got EOF from 127.0.0.1:58460 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 22:51:14.790875 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 6886
I20260809 22:51:14.799777 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:14.792012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59616 (local address 127.23.131.65:35631)
0809 22:51:14.792778 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:14.792791 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:14.792817 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:51:14.792871 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:14.792877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:14.793093 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:14.793342 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:14.793848 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.794883 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.796310 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.796945 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.797097 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:14.798311 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:14.798320 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:14.798333 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:14.798907 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:14.798956 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:14.798978 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:14.799116 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:14.799297 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 22:51:14.799447 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":312,"threads_started":1}
I20260809 22:51:14.801117 7068 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:14.886768 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 6886
I20260809 22:51:14.913280 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 7083
I20260809 22:51:14.921542 7524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:14.914314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.23.131.66:41265)
0809 22:51:14.914821 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:14.914828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:14.914856 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:51:14.914924 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:14.914930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:14.915153 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:14.915394 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:14.915817 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.916817 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.918127 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:14.918676 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:14.918822 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:14.920050 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:14.920058 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:14.920070 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:14.920668 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:14.920715 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:14.920740 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:14.920884 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:14.921033 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 22:51:14.921187 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":250,"threads_started":1}
I20260809 22:51:14.922832 7295 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:15.006736 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 7083
I20260809 22:51:15.032095 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 7306
I20260809 22:51:15.041033 7528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:15.033289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48880 (local address 127.23.131.67:33307)
0809 22:51:15.033988 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:15.033996 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:15.034028 (+ 32us) server_negotiation.cc:407] Connection header received
0809 22:51:15.034090 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:15.034096 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:15.034315 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:15.034444 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:15.034887 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:15.036061 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:15.037356 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:15.037957 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:15.038083 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:15.039410 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:15.039423 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:15.039439 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:15.040066 (+ 627us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:15.040117 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:15.040138 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:15.040250 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:15.040421 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 22:51:15.040622 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":387,"threads_started":1}
I20260809 22:51:15.042429 7499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:15.128729 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 7306
I20260809 22:51:15.167469 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 6746
I20260809 22:51:15.168975 6841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:15.289062 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 6746
2026-08-09T22:51:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2734 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T22:51:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:51:15Z Disabled control of system clock
I20260809 22:51:15.396617 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:38089
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:38089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 22:51:15.762158 7539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:15.762473 7539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:15.762651 7539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:15.770084 7539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:51:15.770206 7539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:15.770292 7539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:15.770406 7539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:51:15.770469 7539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:51:15.780069 7539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:38089
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:38089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:15.781440 7539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:15.783327 7539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:15.795874 7547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:15.795933 7551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:15.795961 7546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:15.796811 7539 server_base.cc:1034] running on GCE node
I20260809 22:51:15.797734 7539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:15.799329 7539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:15.800577 7539 hybrid_clock.cc:648] HybridClock initialized: now 1786315875800531 us; error 38 us; skew 500 ppm
I20260809 22:51:15.800999 7539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:15.803537 7539 webserver.cc:460] Webserver started at http://127.23.131.126:35269/ using document root <none> and password file <none>
I20260809 22:51:15.804368 7539 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:15.804528 7539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:15.804889 7539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:15.808295 7539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "10ffa6e8f1cb4d62b54fb33e11f85956"
format_stamp: "Formatted at 2026-08-09 22:51:15 on dist-test-slave-92m1"
server_key: "e548384101620d50a106c496987bc6b0"
server_key_iv: "c8c7d83b8036ecba052db86a567f50b8"
server_key_version: "encryptionkey@0"
I20260809 22:51:15.809270 7539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "10ffa6e8f1cb4d62b54fb33e11f85956"
format_stamp: "Formatted at 2026-08-09 22:51:15 on dist-test-slave-92m1"
server_key: "e548384101620d50a106c496987bc6b0"
server_key_iv: "c8c7d83b8036ecba052db86a567f50b8"
server_key_version: "encryptionkey@0"
I20260809 22:51:15.815382 7539 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260809 22:51:15.819511 7560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:15.821092 7539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:51:15.821321 7539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "10ffa6e8f1cb4d62b54fb33e11f85956"
format_stamp: "Formatted at 2026-08-09 22:51:15 on dist-test-slave-92m1"
server_key: "e548384101620d50a106c496987bc6b0"
server_key_iv: "c8c7d83b8036ecba052db86a567f50b8"
server_key_version: "encryptionkey@0"
I20260809 22:51:15.821616 7539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:15.827872 7539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:15.828766 7539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:15.829107 7539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:15.848737 7539 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:38089
I20260809 22:51:15.848788 7642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:38089 every 8 connection(s)
I20260809 22:51:15.850283 7539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:51:15.850773 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 7539
I20260809 22:51:15.851030 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:51:15.852052 24077 external_mini_cluster.cc:1428] Setting key cf62126b2b48277a8b2ceebcb251ec9a
I20260809 22:51:15.855096 7643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:51:15.860998 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:15.854240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41294 (local address 127.23.131.126:38089)
0809 22:51:15.855384 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:15.855401 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:15.855447 (+ 46us) server_negotiation.cc:407] Connection header received
0809 22:51:15.857055 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:15.857076 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:15.857505 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:15.857927 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:15.859101 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:15.859108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:15.859120 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:15.859134 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:15.859282 (+ 148us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:15.859304 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:15.859605 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:15.859755 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 22:51:15.860014 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":404,"threads_started":1}
I20260809 22:51:15.867460 7643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956: Bootstrap starting.
I20260809 22:51:15.870837 7643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956: Neither blocks nor log segments found. Creating new log.
I20260809 22:51:15.872040 7643 log.cc:824] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956: Log is configured to *not* fsync() on all Append() calls
I20260809 22:51:15.874888 7643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956: No bootstrap required, opened a new log
I20260809 22:51:15.882831 7643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38089 } }
I20260809 22:51:15.883285 7643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:51:15.883404 7643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ffa6e8f1cb4d62b54fb33e11f85956, State: Initialized, Role: FOLLOWER
I20260809 22:51:15.884073 7643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38089 } }
I20260809 22:51:15.884333 7643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:51:15.884490 7643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:51:15.884680 7643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:51:15.886940 7643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38089 } }
I20260809 22:51:15.887534 7643 leader_election.cc:302] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10ffa6e8f1cb4d62b54fb33e11f85956; no voters:
I20260809 22:51:15.888167 7643 leader_election.cc:288] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:51:15.888373 7649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:51:15.889957 7649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [term 1 LEADER]: Becoming Leader. State: Replica: 10ffa6e8f1cb4d62b54fb33e11f85956, State: Running, Role: LEADER
I20260809 22:51:15.890592 7643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:51:15.890571 7649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38089 } }
I20260809 22:51:15.893887 7650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38089 } } }
I20260809 22:51:15.894325 7650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [sys.catalog]: This master's current role is: LEADER
I20260809 22:51:15.894873 7652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10ffa6e8f1cb4d62b54fb33e11f85956. Latest consensus state: current_term: 1 leader_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10ffa6e8f1cb4d62b54fb33e11f85956" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38089 } } }
I20260809 22:51:15.895192 7652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956 [sys.catalog]: This master's current role is: LEADER
I20260809 22:51:15.897545 7663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:51:15.902837 7663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:51:15.911513 7663 catalog_manager.cc:1347] Generated new cluster ID: ed3a1d24e0c04cf0abeeae60cb13a7c2
I20260809 22:51:15.911648 7663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:51:15.934152 7663 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:51:15.934618 7663 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:51:15.942518 7663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10ffa6e8f1cb4d62b54fb33e11f85956: Generated new TSK 0
I20260809 22:51:15.943593 7663 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:51:15.956974 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38089
--builtin_ntp_servers=127.23.131.84:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 22:51:16.320961 7677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:16.321259 7677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:16.321350 7677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:16.329264 7677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:16.329380 7677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:16.329504 7677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:51:16.339082 7677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:16.340384 7677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:16.342338 7677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:16.355908 7700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:16.356099 7693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:16.356079 7694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:16.357151 7677 server_base.cc:1034] running on GCE node
I20260809 22:51:16.357788 7677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:16.358819 7677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:16.360086 7677 hybrid_clock.cc:648] HybridClock initialized: now 1786315876360028 us; error 61 us; skew 500 ppm
I20260809 22:51:16.360488 7677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:16.367750 7677 webserver.cc:460] Webserver started at http://127.23.131.65:39261/ using document root <none> and password file <none>
I20260809 22:51:16.368490 7677 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:16.368585 7677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:16.368868 7677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:16.371893 7677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "970356461a6c4619a661250c76bd9a87"
format_stamp: "Formatted at 2026-08-09 22:51:16 on dist-test-slave-92m1"
server_key: "47ccedbf1ed248902c30380c3ee9f896"
server_key_iv: "f34c7c48009372202d5f878dcbdd31b4"
server_key_version: "encryptionkey@0"
I20260809 22:51:16.372697 7677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "970356461a6c4619a661250c76bd9a87"
format_stamp: "Formatted at 2026-08-09 22:51:16 on dist-test-slave-92m1"
server_key: "47ccedbf1ed248902c30380c3ee9f896"
server_key_iv: "f34c7c48009372202d5f878dcbdd31b4"
server_key_version: "encryptionkey@0"
I20260809 22:51:16.378213 7677 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:51:16.381716 7707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:16.383044 7677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:51:16.383291 7677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "970356461a6c4619a661250c76bd9a87"
format_stamp: "Formatted at 2026-08-09 22:51:16 on dist-test-slave-92m1"
server_key: "47ccedbf1ed248902c30380c3ee9f896"
server_key_iv: "f34c7c48009372202d5f878dcbdd31b4"
server_key_version: "encryptionkey@0"
I20260809 22:51:16.383526 7677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:16.389369 7677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:16.390178 7677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:16.390481 7677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:16.391623 7677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:16.393111 7677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:16.393239 7677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:16.393373 7677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:16.393464 7677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:16.428658 7677 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:41899
I20260809 22:51:16.428714 7892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:41899 every 8 connection(s)
I20260809 22:51:16.430047 7677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:51:16.432500 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 7677
I20260809 22:51:16.432755 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:51:16.433548 24077 external_mini_cluster.cc:1428] Setting key 6de6c79534f862ba061a122614c3d2bc
I20260809 22:51:16.436343 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38089
--builtin_ntp_servers=127.23.131.84:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 22:51:16.438906 7897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:16.432816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:38789 (local address 127.23.131.126:38089)
0809 22:51:16.433300 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:16.433308 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:16.434753 (+ 1445us) server_negotiation.cc:407] Connection header received
0809 22:51:16.436544 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:16.436549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:16.436616 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:16.436748 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:16.438113 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:16.438119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:16.438124 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:16.438142 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:16.438193 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:16.438205 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:16.438338 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:16.438549 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 22:51:16.438621 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":228,"threads_started":1}
I20260809 22:51:16.439917 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:16.433414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38089 (local address 127.23.131.65:38789)
0809 22:51:16.434581 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:16.434640 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:16.436258 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:16.436990 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:16.436997 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:16.437085 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:16.437812 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:51:16.437814 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:16.437852 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:51:16.437937 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:16.438304 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:16.438318 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:16.438326 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 22:51:16.438635 (+ 309us) client_negotiation.cc:240] Negotiation successful
0809 22:51:16.438883 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":443,"threads_started":1}
I20260809 22:51:16.441659 7893 heartbeater.cc:347] Connected to a master server at 127.23.131.126:38089
I20260809 22:51:16.441972 7893 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:16.442607 7893 heartbeater.cc:511] Master 127.23.131.126:38089 requested a full tablet report, sending...
I20260809 22:51:16.445137 7589 ts_manager.cc:194] Registered new tserver with Master: 970356461a6c4619a661250c76bd9a87 (127.23.131.65:41899)
W20260809 22:51:16.795388 7900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:16.795698 7900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:16.795873 7900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:16.803562 7900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:16.803683 7900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:16.803856 7900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:51:16.813550 7900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:16.814994 7900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:16.816941 7900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:16.831238 7906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:16.831342 7907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:16.831403 7910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:16.832491 7900 server_base.cc:1034] running on GCE node
I20260809 22:51:16.833134 7900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:16.834143 7900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:16.835302 7900 hybrid_clock.cc:648] HybridClock initialized: now 1786315876835256 us; error 40 us; skew 500 ppm
I20260809 22:51:16.835646 7900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:16.837944 7900 webserver.cc:460] Webserver started at http://127.23.131.66:43861/ using document root <none> and password file <none>
I20260809 22:51:16.838671 7900 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:16.838814 7900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:16.839160 7900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:16.842209 7900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "166c4dc2066e4968be49d4b5cfb87c27"
format_stamp: "Formatted at 2026-08-09 22:51:16 on dist-test-slave-92m1"
server_key: "419950edb43a83a1403764d343590858"
server_key_iv: "8edf23106f0cfbb37f4a948dd3f78d5f"
server_key_version: "encryptionkey@0"
I20260809 22:51:16.843029 7900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "166c4dc2066e4968be49d4b5cfb87c27"
format_stamp: "Formatted at 2026-08-09 22:51:16 on dist-test-slave-92m1"
server_key: "419950edb43a83a1403764d343590858"
server_key_iv: "8edf23106f0cfbb37f4a948dd3f78d5f"
server_key_version: "encryptionkey@0"
I20260809 22:51:16.848347 7900 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 22:51:16.852012 7921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:16.853458 7900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:51:16.853662 7900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "166c4dc2066e4968be49d4b5cfb87c27"
format_stamp: "Formatted at 2026-08-09 22:51:16 on dist-test-slave-92m1"
server_key: "419950edb43a83a1403764d343590858"
server_key_iv: "8edf23106f0cfbb37f4a948dd3f78d5f"
server_key_version: "encryptionkey@0"
I20260809 22:51:16.853902 7900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:16.860023 7900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:16.860884 7900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:16.861181 7900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:16.862339 7900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:16.863952 7900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:16.864081 7900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:16.864215 7900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:16.864305 7900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:16.900712 7900 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:38629
I20260809 22:51:16.900774 8100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:38629 every 8 connection(s)
I20260809 22:51:16.902154 7900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:51:16.903360 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 7900
I20260809 22:51:16.903568 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:51:16.904201 24077 external_mini_cluster.cc:1428] Setting key 6bb37ac79e10a98b6a1d4ef969732272
I20260809 22:51:16.907686 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38089
--builtin_ntp_servers=127.23.131.84:41593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 22:51:16.911582 7897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:16.905516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:39205 (local address 127.23.131.126:38089)
0809 22:51:16.905688 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:16.905693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:16.907245 (+ 1552us) server_negotiation.cc:407] Connection header received
0809 22:51:16.909087 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:16.909093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:16.909177 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:16.909302 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:16.910745 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:16.910751 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:16.910756 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:16.910781 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:16.910814 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:16.910826 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:16.910962 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:16.911173 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 22:51:16.911276 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 22:51:16.912568 8103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:16.906015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38089 (local address 127.23.131.66:39205)
0809 22:51:16.907071 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:16.907107 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:16.908799 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:16.909540 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:16.909549 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:16.909643 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:16.910410 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:51:16.910415 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:16.910454 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:51:16.910544 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:16.910939 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:16.910949 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:16.910957 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 22:51:16.911288 (+ 331us) client_negotiation.cc:240] Negotiation successful
0809 22:51:16.911567 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":310,"threads_started":1}
I20260809 22:51:16.914173 8101 heartbeater.cc:347] Connected to a master server at 127.23.131.126:38089
I20260809 22:51:16.914520 8101 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:16.915138 8101 heartbeater.cc:511] Master 127.23.131.126:38089 requested a full tablet report, sending...
I20260809 22:51:16.916721 7589 ts_manager.cc:194] Registered new tserver with Master: 166c4dc2066e4968be49d4b5cfb87c27 (127.23.131.66:38629)
W20260809 22:51:17.276473 8105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:17.276784 8105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:17.276955 8105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:17.284472 8105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:17.284587 8105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:17.284775 8105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:51:17.294756 8105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:17.296140 8105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:17.298013 8105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:17.312237 8119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:17.312173 8122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:17.312304 8118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:17.312954 8105 server_base.cc:1034] running on GCE node
I20260809 22:51:17.313637 8105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:17.314644 8105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:17.315881 8105 hybrid_clock.cc:648] HybridClock initialized: now 1786315877315837 us; error 64 us; skew 500 ppm
I20260809 22:51:17.316228 8105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:51:17.318572 8105 webserver.cc:460] Webserver started at http://127.23.131.67:37877/ using document root <none> and password file <none>
I20260809 22:51:17.319366 8105 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:17.319523 8105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:17.319865 8105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:17.322753 8105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "07b4d14e2a904e76b2943d93b2bae894"
format_stamp: "Formatted at 2026-08-09 22:51:17 on dist-test-slave-92m1"
server_key: "52559afc92d3dde24d148bc559023fce"
server_key_iv: "e3290f4107e113888ec9788aa58cdb3a"
server_key_version: "encryptionkey@0"
I20260809 22:51:17.323716 8105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "07b4d14e2a904e76b2943d93b2bae894"
format_stamp: "Formatted at 2026-08-09 22:51:17 on dist-test-slave-92m1"
server_key: "52559afc92d3dde24d148bc559023fce"
server_key_iv: "e3290f4107e113888ec9788aa58cdb3a"
server_key_version: "encryptionkey@0"
I20260809 22:51:17.329093 8105 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:51:17.332681 8129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:17.333997 8105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:51:17.334184 8105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "07b4d14e2a904e76b2943d93b2bae894"
format_stamp: "Formatted at 2026-08-09 22:51:17 on dist-test-slave-92m1"
server_key: "52559afc92d3dde24d148bc559023fce"
server_key_iv: "e3290f4107e113888ec9788aa58cdb3a"
server_key_version: "encryptionkey@0"
I20260809 22:51:17.334419 8105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:17.340948 8105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:17.341806 8105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:17.342111 8105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:17.343109 8105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:17.344619 8105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:17.344751 8105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:17.344887 8105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:17.344995 8105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:17.381349 8105 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:42051
I20260809 22:51:17.381443 8304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:42051 every 8 connection(s)
I20260809 22:51:17.382725 8105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:51:17.384414 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 8105
I20260809 22:51:17.384625 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:51:17.385088 24077 external_mini_cluster.cc:1428] Setting key 787fb0d6b8f9f7c8673ea1ef732815e4
I20260809 22:51:17.391904 7897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:17.385524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:55671 (local address 127.23.131.126:38089)
0809 22:51:17.385760 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:17.385767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:17.387525 (+ 1758us) server_negotiation.cc:407] Connection header received
0809 22:51:17.389588 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:17.389593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:17.389660 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:17.389762 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:17.391145 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:17.391168 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:17.391171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:17.391189 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:17.391270 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:17.391283 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:17.391386 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:17.391612 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 22:51:17.391665 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:51:17.392956 8312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:17.386190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38089 (local address 127.23.131.67:55671)
0809 22:51:17.387353 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:17.387400 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:17.389326 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:17.389960 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:17.389967 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:17.390053 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:17.390693 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:51:17.390695 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:17.390762 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:51:17.390883 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:17.391395 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:17.391406 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:17.391414 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 22:51:17.391670 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 22:51:17.391933 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":372,"threads_started":1}
I20260809 22:51:17.394536 8308 heartbeater.cc:347] Connected to a master server at 127.23.131.126:38089
I20260809 22:51:17.394912 8308 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:17.395579 8308 heartbeater.cc:511] Master 127.23.131.126:38089 requested a full tablet report, sending...
I20260809 22:51:17.397032 7589 ts_manager.cc:194] Registered new tserver with Master: 07b4d14e2a904e76b2943d93b2bae894 (127.23.131.67:42051)
I20260809 22:51:17.400969 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 22:51:17.407245 7897 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:51:17.405609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41302 (local address 127.23.131.126:38089)
0809 22:51:17.405817 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:17.405827 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:17.406288 (+ 461us) server_negotiation.cc:407] Connection header received
0809 22:51:17.406411 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:17.406414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:17.406470 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:17.406562 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:17.406907 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41302: BlockingRecv error: recv got EOF from 127.0.0.1:41302 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 22:51:17.408286 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 7677
I20260809 22:51:17.412112 8326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:17.409255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.23.131.65:41899)
0809 22:51:17.409799 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:17.409806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:17.409830 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:51:17.409886 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:17.409893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:17.410095 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:17.410280 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:17.411346 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:17.411352 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:17.411363 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:17.411381 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:17.411422 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:17.411436 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:17.411598 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:17.411708 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 22:51:17.411809 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":234,"threads_started":1}
I20260809 22:51:17.413431 7887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:17.494877 7893 heartbeater.cc:503] Master 127.23.131.126:38089 was elected leader, sending a full tablet report...
I20260809 22:51:17.499421 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 7677
I20260809 22:51:17.526335 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 7900
I20260809 22:51:17.530030 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:17.527415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44132 (local address 127.23.131.66:38629)
0809 22:51:17.528004 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:17.528011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:17.528045 (+ 34us) server_negotiation.cc:407] Connection header received
0809 22:51:17.528110 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:17.528116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:17.528332 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:17.528466 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:17.529354 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:17.529361 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:17.529372 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:17.529391 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:17.529438 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:17.529453 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:17.529558 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:17.529664 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 22:51:17.529750 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":271,"threads_started":1}
I20260809 22:51:17.531456 8096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:17.616487 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 7900
I20260809 22:51:17.644158 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 8105
I20260809 22:51:17.648352 8334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:17.645109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44796 (local address 127.23.131.67:42051)
0809 22:51:17.645751 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:17.645758 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:17.645790 (+ 32us) server_negotiation.cc:407] Connection header received
0809 22:51:17.645855 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:17.645861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:17.646088 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:17.646279 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:17.647544 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:17.647550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:17.647562 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:51:17.647574 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:17.647620 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:51:17.647634 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:17.647840 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:17.647914 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 22:51:17.648039 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":297,"threads_started":1}
I20260809 22:51:17.649621 8297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:17.735111 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 8105
I20260809 22:51:17.762161 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 7539
I20260809 22:51:17.763604 7636 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:17.873133 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 7539
2026-08-09T22:51:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2582 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:51:18 dist-test-slave-92m1 krb5kdc[8344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:51:18 dist-test-slave-92m1 krb5kdc[8344](info): set up 2 sockets
Aug 09 22:51:18 dist-test-slave-92m1 krb5kdc[8344](info): commencing operation
krb5kdc: starting...
W20260809 22:51:19.261966 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:51:19 dist-test-slave-92m1 krb5kdc[8344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:51:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:51:19.612735 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41331
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:51:19.979012 8367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:19.979521 8367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:19.979696 8367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:19.987401 8367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:51:19.987538 8367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:19.987676 8367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:19.987777 8367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:51:19.987851 8367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:51:19.998387 8367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:19.999912 8367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:20.001334 8367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:20.014602 8373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:20.014528 8377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:20.014566 8374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:20.015834 8367 server_base.cc:1034] running on GCE node
I20260809 22:51:20.016680 8367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:20.018234 8367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:20.019449 8367 hybrid_clock.cc:648] HybridClock initialized: now 1786315880019396 us; error 33 us; skew 500 ppm
I20260809 22:51:20.019838 8367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:51:20 dist-test-slave-92m1 krb5kdc[8344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315880, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:51:20.023358 8367 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:51:20.024981 8367 webserver.cc:460] Webserver started at http://127.23.131.126:45239/ using document root <none> and password file <none>
I20260809 22:51:20.025697 8367 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:20.025849 8367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:20.026188 8367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:20.029397 8367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "8d39d0de78a745b5ac2a8f6a0c970c13"
format_stamp: "Formatted at 2026-08-09 22:51:20 on dist-test-slave-92m1"
server_key: "083468cc569e8533108ab37e218bd0ee"
server_key_iv: "4c7865a158edbdb64646fb7281568ba6"
server_key_version: "encryptionkey@0"
I20260809 22:51:20.030241 8367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "8d39d0de78a745b5ac2a8f6a0c970c13"
format_stamp: "Formatted at 2026-08-09 22:51:20 on dist-test-slave-92m1"
server_key: "083468cc569e8533108ab37e218bd0ee"
server_key_iv: "4c7865a158edbdb64646fb7281568ba6"
server_key_version: "encryptionkey@0"
I20260809 22:51:20.036121 8367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:51:20.039973 8388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:20.041422 8367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 22:51:20.041633 8367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "8d39d0de78a745b5ac2a8f6a0c970c13"
format_stamp: "Formatted at 2026-08-09 22:51:20 on dist-test-slave-92m1"
server_key: "083468cc569e8533108ab37e218bd0ee"
server_key_iv: "4c7865a158edbdb64646fb7281568ba6"
server_key_version: "encryptionkey@0"
I20260809 22:51:20.041859 8367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:20.061463 8367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:20.065820 8367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:20.066154 8367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:20.086637 8367 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41331
I20260809 22:51:20.086671 8465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41331 every 8 connection(s)
I20260809 22:51:20.088176 8367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:51:20.088514 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 8367
I20260809 22:51:20.088763 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:51:20.089640 24077 external_mini_cluster.cc:1428] Setting key 221e42e67cb4af193aa099540ba1fac4
I20260809 22:51:20.092911 8466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:51:20 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:51:20.104394 8466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13: Bootstrap starting.
I20260809 22:51:20.107789 8466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13: Neither blocks nor log segments found. Creating new log.
I20260809 22:51:20.108901 8466 log.cc:824] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13: Log is configured to *not* fsync() on all Append() calls
I20260809 22:51:20.112663 8466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13: No bootstrap required, opened a new log
I20260809 22:51:20.113709 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:20.091831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60742 (local address 127.23.131.126:41331)
0809 22:51:20.092677 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:20.092690 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:20.092731 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:51:20.094491 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:20.094514 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:20.094883 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:20.095319 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:20.097014 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:20.098417 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:20.099858 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:20.100570 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:20.100787 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:20.105447 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:20.105456 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:20.105471 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:20.105518 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:20.108874 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:20.109736 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:20.109743 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:20.109750 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:20.109925 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:20.110448 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:20.110469 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:20.110472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:20.111159 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:20.111538 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:20.111857 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 22:51:20.112317 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":376,"threads_started":1}
I20260809 22:51:20.122751 8466 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41331 } }
I20260809 22:51:20.123169 8466 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:51:20.123334 8466 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d39d0de78a745b5ac2a8f6a0c970c13, State: Initialized, Role: FOLLOWER
I20260809 22:51:20.123965 8466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41331 } }
I20260809 22:51:20.124187 8466 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:51:20.124293 8466 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:51:20.124433 8466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:51:20.127316 8466 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41331 } }
I20260809 22:51:20.127849 8466 leader_election.cc:302] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d39d0de78a745b5ac2a8f6a0c970c13; no voters:
I20260809 22:51:20.128473 8466 leader_election.cc:288] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:51:20.128630 8476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:51:20.129380 8476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [term 1 LEADER]: Becoming Leader. State: Replica: 8d39d0de78a745b5ac2a8f6a0c970c13, State: Running, Role: LEADER
I20260809 22:51:20.129972 8476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41331 } }
I20260809 22:51:20.130690 8466 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:51:20.133687 8477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41331 } } }
I20260809 22:51:20.133728 8478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d39d0de78a745b5ac2a8f6a0c970c13. Latest consensus state: current_term: 1 leader_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d39d0de78a745b5ac2a8f6a0c970c13" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41331 } } }
I20260809 22:51:20.134053 8477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [sys.catalog]: This master's current role is: LEADER
I20260809 22:51:20.134166 8478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13 [sys.catalog]: This master's current role is: LEADER
I20260809 22:51:20.136505 8490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:51:20.141247 8490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:51:20.150115 8490 catalog_manager.cc:1347] Generated new cluster ID: 9f6b7f5295d04282bdd34db96fb308c9
I20260809 22:51:20.150319 8490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:51:20.177373 8490 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:51:20.179519 8490 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:51:20.199528 8490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13: Generated new TSK 0
I20260809 22:51:20.200495 8490 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:51:20.300827 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41331
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:51:20.689807 8517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:20.690104 8517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:20.690284 8517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:20.698311 8517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:20.698487 8517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:20.698694 8517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:51:20.709738 8517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:20.711364 8517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:20.712859 8517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:20.727898 8522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:20.727815 8523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:20.727788 8526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:20.728856 8517 server_base.cc:1034] running on GCE node
I20260809 22:51:20.729511 8517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:20.730686 8517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:20.731969 8517 hybrid_clock.cc:648] HybridClock initialized: now 1786315880731922 us; error 56 us; skew 500 ppm
I20260809 22:51:20.732264 8517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:51:20 dist-test-slave-92m1 krb5kdc[8344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315880, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:51:20.735930 8517 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:51:20.737635 8517 webserver.cc:460] Webserver started at http://127.23.131.65:32783/ using document root <none> and password file <none>
I20260809 22:51:20.738363 8517 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:20.738523 8517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:20.738842 8517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:20.742219 8517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "8577815eb6d64ed6bc0847c06be452c5"
format_stamp: "Formatted at 2026-08-09 22:51:20 on dist-test-slave-92m1"
server_key: "392b093e7341f75d4fc9a3e9f7b083fd"
server_key_iv: "aafc54494bf35065d206719b73b12b1f"
server_key_version: "encryptionkey@0"
I20260809 22:51:20.743402 8517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "8577815eb6d64ed6bc0847c06be452c5"
format_stamp: "Formatted at 2026-08-09 22:51:20 on dist-test-slave-92m1"
server_key: "392b093e7341f75d4fc9a3e9f7b083fd"
server_key_iv: "aafc54494bf35065d206719b73b12b1f"
server_key_version: "encryptionkey@0"
I20260809 22:51:20.749234 8517 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:51:20.753023 8536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:20.754361 8517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:51:20.754562 8517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "8577815eb6d64ed6bc0847c06be452c5"
format_stamp: "Formatted at 2026-08-09 22:51:20 on dist-test-slave-92m1"
server_key: "392b093e7341f75d4fc9a3e9f7b083fd"
server_key_iv: "aafc54494bf35065d206719b73b12b1f"
server_key_version: "encryptionkey@0"
I20260809 22:51:20.754781 8517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:20.777098 8517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:20.781450 8517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:20.781783 8517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:20.782850 8517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:20.784385 8517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:20.784502 8517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:20.784672 8517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:20.784750 8517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:20.821698 8517 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:33339
I20260809 22:51:20.821749 8728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:33339 every 8 connection(s)
I20260809 22:51:20.823331 8517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:51:20.833153 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 8517
I20260809 22:51:20.833436 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:51:20.834112 24077 external_mini_cluster.cc:1428] Setting key 13012314596bdd7765e389c3dd9aa9d7
Aug 09 22:51:20 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315880, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:51:20.848354 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:20.826150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:44767 (local address 127.23.131.126:41331)
0809 22:51:20.826676 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:20.826681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:20.827837 (+ 1156us) server_negotiation.cc:407] Connection header received
0809 22:51:20.829825 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:20.829831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:20.829929 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:20.830075 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:20.832085 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:20.833188 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:20.835458 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:20.835907 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:20.836097 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:20.840925 (+ 4828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:20.840931 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:20.840935 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:20.840976 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:20.844039 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:20.845278 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:20.845283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:20.845285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:20.845539 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:20.846190 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:20.846195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:20.846197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:20.846607 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:20.846779 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:20.847812 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0809 22:51:20.848066 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":285,"threads_started":1}
I20260809 22:51:20.849907 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:20.826799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41331 (local address 127.23.131.65:44767)
0809 22:51:20.827655 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:20.827705 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:20.829513 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:20.830337 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:20.830346 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:20.831101 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:20.831869 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:20.831889 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:20.833421 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:20.833426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:20.835175 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:20.835190 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:20.836219 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:20.836229 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:20.836586 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:20.837433 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:20.837464 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:20.840594 (+ 3130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:20.844241 (+ 3647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:51:20.844255 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:51:20.844279 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:51:20.845077 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:51:20.845707 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:51:20.845715 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:51:20.845721 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:51:20.846010 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:51:20.846748 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:20.846760 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:20.847315 (+ 555us) client_negotiation.cc:769] Sending connection context
0809 22:51:20.847664 (+ 349us) client_negotiation.cc:240] Negotiation successful
0809 22:51:20.848334 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":405,"threads_started":1}
I20260809 22:51:20.851838 8731 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41331
I20260809 22:51:20.852186 8731 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:20.853165 8731 heartbeater.cc:511] Master 127.23.131.126:41331 requested a full tablet report, sending...
I20260809 22:51:20.855620 8416 ts_manager.cc:194] Registered new tserver with Master: 8577815eb6d64ed6bc0847c06be452c5 (127.23.131.65:33339)
I20260809 22:51:20.857134 8416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:44767
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:51:20.912946 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41331
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:51:21.281538 8740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:21.281863 8740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:21.282037 8740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:21.289449 8740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:21.289566 8740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:21.289759 8740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:51:21.300151 8740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:21.301602 8740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:21.302976 8740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:21.316604 8747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:21.316651 8748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:21.316700 8751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:21.317544 8740 server_base.cc:1034] running on GCE node
I20260809 22:51:21.318270 8740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:21.319418 8740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:21.320658 8740 hybrid_clock.cc:648] HybridClock initialized: now 1786315881320598 us; error 59 us; skew 500 ppm
I20260809 22:51:21.320978 8740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:51:21 dist-test-slave-92m1 krb5kdc[8344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315881, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:51:21.324391 8740 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:51:21.325970 8740 webserver.cc:460] Webserver started at http://127.23.131.66:40181/ using document root <none> and password file <none>
I20260809 22:51:21.326638 8740 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:21.326740 8740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:21.326990 8740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:21.330015 8740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "50428f80cce24381a0507d4552233dee"
format_stamp: "Formatted at 2026-08-09 22:51:21 on dist-test-slave-92m1"
server_key: "3490ee71af6db973ecefa6c3f5d1acd3"
server_key_iv: "b0d1002545475c8f33eca15f9feb22c4"
server_key_version: "encryptionkey@0"
I20260809 22:51:21.330897 8740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "50428f80cce24381a0507d4552233dee"
format_stamp: "Formatted at 2026-08-09 22:51:21 on dist-test-slave-92m1"
server_key: "3490ee71af6db973ecefa6c3f5d1acd3"
server_key_iv: "b0d1002545475c8f33eca15f9feb22c4"
server_key_version: "encryptionkey@0"
I20260809 22:51:21.336803 8740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 22:51:21.340376 8765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:21.341840 8740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:51:21.342124 8740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "50428f80cce24381a0507d4552233dee"
format_stamp: "Formatted at 2026-08-09 22:51:21 on dist-test-slave-92m1"
server_key: "3490ee71af6db973ecefa6c3f5d1acd3"
server_key_iv: "b0d1002545475c8f33eca15f9feb22c4"
server_key_version: "encryptionkey@0"
I20260809 22:51:21.342358 8740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:21.379894 8740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:21.384799 8740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:21.385166 8740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:21.386255 8740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:21.387830 8740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:21.387953 8740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:21.388118 8740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:21.388206 8740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:21.425766 8740 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:39791
I20260809 22:51:21.425863 8948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:39791 every 8 connection(s)
I20260809 22:51:21.427141 8740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:51:21.429725 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 8740
I20260809 22:51:21.429975 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:51:21.430706 24077 external_mini_cluster.cc:1428] Setting key 1ebac45b85479359c6c58ce9dffb86f9
Aug 09 22:51:21 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315881, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:51:21.453125 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:21.429897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:33995 (local address 127.23.131.126:41331)
0809 22:51:21.432837 (+ 2940us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:21.432843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:21.432865 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:51:21.435192 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:21.435234 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:21.435319 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:21.435419 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:21.437616 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:21.438368 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:21.440902 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:21.441406 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:21.441524 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:21.446137 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:21.446146 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:21.446150 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:21.446196 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:21.449667 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:21.450591 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:21.450596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:21.450598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:21.450729 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:21.451303 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:21.451307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:21.451309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:21.451592 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:21.451709 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:21.452636 (+ 927us) server_negotiation.cc:299] Negotiation successful
0809 22:51:21.452811 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2823,"thread_start_us":2712,"threads_started":1}
I20260809 22:51:21.454702 8955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:21.430485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41331 (local address 127.23.131.66:33995)
0809 22:51:21.432201 (+ 1716us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:21.432264 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:21.434810 (+ 2546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:21.435711 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:21.435725 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:21.436559 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:21.437391 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:21.437418 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:21.438554 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:21.438561 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:21.440738 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:21.440757 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:21.441656 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:21.441666 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:21.442007 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:21.442776 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:21.442810 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:21.445831 (+ 3021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:21.449838 (+ 4007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:51:21.449845 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:51:21.449859 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:51:21.450437 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:51:21.450853 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:51:21.450861 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:51:21.450867 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:51:21.451132 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:51:21.451728 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:21.451739 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:21.452217 (+ 478us) client_negotiation.cc:769] Sending connection context
0809 22:51:21.452537 (+ 320us) client_negotiation.cc:240] Negotiation successful
0809 22:51:21.453152 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1318,"thread_start_us":1063,"threads_started":1}
I20260809 22:51:21.456535 8949 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41331
I20260809 22:51:21.456887 8949 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:21.457837 8949 heartbeater.cc:511] Master 127.23.131.126:41331 requested a full tablet report, sending...
I20260809 22:51:21.459771 8416 ts_manager.cc:194] Registered new tserver with Master: 50428f80cce24381a0507d4552233dee (127.23.131.66:39791)
I20260809 22:51:21.460636 8416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:33995
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:51:21.510541 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41331
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:51:21.861239 8731 heartbeater.cc:503] Master 127.23.131.126:41331 was elected leader, sending a full tablet report...
W20260809 22:51:21.895174 8960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:51:21.895603 8960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:51:21.895794 8960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:51:21.903354 8960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:51:21.903520 8960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:51:21.903718 8960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:51:21.913859 8960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:51:21.915364 8960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:51:21.916714 8960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:51:21.931033 8965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:21.931056 8966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:51:21.931080 8970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:51:21.936882 8960 server_base.cc:1034] running on GCE node
I20260809 22:51:21.937615 8960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:51:21.938725 8960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:51:21.939942 8960 hybrid_clock.cc:648] HybridClock initialized: now 1786315881939850 us; error 81 us; skew 500 ppm
I20260809 22:51:21.940299 8960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:51:21 dist-test-slave-92m1 krb5kdc[8344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315881, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:51:21.943719 8960 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:51:21.945400 8960 webserver.cc:460] Webserver started at http://127.23.131.67:33113/ using document root <none> and password file <none>
I20260809 22:51:21.946334 8960 fs_manager.cc:359] Metadata directory not provided
I20260809 22:51:21.946444 8960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:51:21.946822 8960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:51:21.950007 8960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "70e3304cd5e349749583a0fda2141d79"
format_stamp: "Formatted at 2026-08-09 22:51:21 on dist-test-slave-92m1"
server_key: "e253696c74f876cc9e079b0d9518e2cd"
server_key_iv: "112a5742c38e3150cc9d526bc7d728da"
server_key_version: "encryptionkey@0"
I20260809 22:51:21.950762 8960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "70e3304cd5e349749583a0fda2141d79"
format_stamp: "Formatted at 2026-08-09 22:51:21 on dist-test-slave-92m1"
server_key: "e253696c74f876cc9e079b0d9518e2cd"
server_key_iv: "112a5742c38e3150cc9d526bc7d728da"
server_key_version: "encryptionkey@0"
I20260809 22:51:21.956670 8960 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 22:51:21.960623 8979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:21.962164 8960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:51:21.962374 8960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "70e3304cd5e349749583a0fda2141d79"
format_stamp: "Formatted at 2026-08-09 22:51:21 on dist-test-slave-92m1"
server_key: "e253696c74f876cc9e079b0d9518e2cd"
server_key_iv: "112a5742c38e3150cc9d526bc7d728da"
server_key_version: "encryptionkey@0"
I20260809 22:51:21.962627 8960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:51:22.000751 8960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:51:22.005228 8960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:51:22.005580 8960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:51:22.006618 8960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:51:22.008138 8960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:51:22.008260 8960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:22.008424 8960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:51:22.008499 8960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:51:22.045715 8960 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:37151
I20260809 22:51:22.045761 9165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:37151 every 8 connection(s)
I20260809 22:51:22.047284 8960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:51:22.048475 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 8960
I20260809 22:51:22.048705 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:51:22.049304 24077 external_mini_cluster.cc:1428] Setting key c87943465ed25ce6b42db127bf32c8e7
Aug 09 22:51:22 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315881, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:51:22.069581 9174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.050296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:40695 (local address 127.23.131.126:41331)
0809 22:51:22.050855 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.050861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.052087 (+ 1226us) server_negotiation.cc:407] Connection header received
0809 22:51:22.054159 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.054166 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.054254 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.054386 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:22.055969 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.056799 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.058397 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.058827 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.058989 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.062716 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:22.062722 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:22.062725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:22.062760 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:22.066318 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.067341 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.067346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.067348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.067500 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.067959 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.067963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.067964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.068253 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:22.068372 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.069096 (+ 724us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.069280 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":283,"threads_started":1}
I20260809 22:51:22.070637 9178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.051036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41331 (local address 127.23.131.67:40695)
0809 22:51:22.051928 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.051967 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.053888 (+ 1921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.054641 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.054649 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.055165 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:51:22.055798 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.055816 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.056978 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.056982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.058238 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.058250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.059077 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.059086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.059378 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.060098 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:51:22.060122 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:51:22.062468 (+ 2346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:51:22.066500 (+ 4032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:51:22.066509 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:51:22.066525 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:51:22.067122 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:51:22.067638 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:51:22.067641 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:51:22.067643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:51:22.067842 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:51:22.068371 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:51:22.068377 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:51:22.068744 (+ 367us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.068984 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.069402 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":471,"threads_started":1}
I20260809 22:51:22.072293 9166 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41331
I20260809 22:51:22.072640 9166 heartbeater.cc:464] Registering TS with master...
I20260809 22:51:22.073424 9166 heartbeater.cc:511] Master 127.23.131.126:41331 requested a full tablet report, sending...
I20260809 22:51:22.075004 8416 ts_manager.cc:194] Registered new tserver with Master: 70e3304cd5e349749583a0fda2141d79 (127.23.131.67:37151)
I20260809 22:51:22.076056 8416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:40695
I20260809 22:51:22.078255 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:51:22.097486 9174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.082992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60758 (local address 127.23.131.126:41331)
0809 22:51:22.083170 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.083175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.083793 (+ 618us) server_negotiation.cc:407] Connection header received
0809 22:51:22.083939 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.083944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.084009 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.084105 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:22.085577 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.086327 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.088218 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.088681 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.088777 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.091826 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:22.091831 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:22.091834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:22.091871 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:22.094827 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.095757 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.095761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.095763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.095902 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.096247 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.096250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.096252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.096579 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:22.096762 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.097075 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.097263 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:51:22.101739 8416 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:51:22.108835 8416 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:51:22.134016 9195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.121915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33339 (local address 127.0.0.1:35804)
0809 22:51:22.122767 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.122819 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.123069 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.125281 (+ 2212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.125290 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.125342 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.125933 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.125947 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.128321 (+ 2374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.128327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.130827 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.130842 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.133002 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.133009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.133234 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.133289 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.133397 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.133604 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":415,"threads_started":1}
I20260809 22:51:22.135531 9198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.122270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35804 (local address 127.23.131.65:33339)
0809 22:51:22.124404 (+ 2134us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.124413 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.124444 (+ 31us) server_negotiation.cc:407] Connection header received
0809 22:51:22.124549 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.124557 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.124979 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.126145 (+ 1166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.126426 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.128146 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.131065 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.132735 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.134610 (+ 1875us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.134892 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.135002 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.135155 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1952,"thread_start_us":1959,"threads_started":1}
I20260809 22:51:22.135578 9199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.122687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43200 (local address 127.23.131.67:37151)
0809 22:51:22.123886 (+ 1199us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.123896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.125864 (+ 1968us) server_negotiation.cc:407] Connection header received
0809 22:51:22.125969 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.125978 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.126232 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.126426 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.127818 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.129484 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.132176 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.133623 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.133752 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.133987 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.134927 (+ 940us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.135122 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":993,"thread_start_us":1782,"threads_started":1}
I20260809 22:51:22.136021 9196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.122063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:37151 (local address 127.0.0.1:43200)
0809 22:51:22.125504 (+ 3441us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.125582 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.125723 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.126713 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.126718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.126746 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.127607 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.127624 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.129654 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.129659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.131969 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.131987 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.134160 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.134167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.134352 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.134393 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.134464 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.134601 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3274,"thread_start_us":3391,"threads_started":1}
I20260809 22:51:22.140812 8622 tablet_service.cc:1467] Processing CreateTablet for tablet 92f5f0501bf74a039eb756fe1fcb341f (DEFAULT_TABLE table=test-table [id=77d194743d8d496fa0d5e25685de0543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:51:22.140811 9060 tablet_service.cc:1467] Processing CreateTablet for tablet 92f5f0501bf74a039eb756fe1fcb341f (DEFAULT_TABLE table=test-table [id=77d194743d8d496fa0d5e25685de0543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:51:22.142652 8622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92f5f0501bf74a039eb756fe1fcb341f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:51:22.142710 9195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.125266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:39791 (local address 127.0.0.1:46568)
0809 22:51:22.134325 (+ 9059us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.134344 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.134447 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.137303 (+ 2856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.137307 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.137337 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.137520 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.137531 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.139276 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.139284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.140444 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.140456 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.142142 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.142148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.142320 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.142345 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.142398 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.142497 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8952,"thread_start_us":10787,"threads_started":1}
I20260809 22:51:22.142809 9060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92f5f0501bf74a039eb756fe1fcb341f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:51:22.143713 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.125615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.23.131.66:39791)
0809 22:51:22.136683 (+ 11068us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.136692 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.136721 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:51:22.136830 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.136838 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.137074 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.137729 (+ 655us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.137961 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.139101 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.140631 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.141950 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.142992 (+ 1042us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.143246 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.143321 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.143445 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10871,"thread_start_us":10706,"threads_started":1}
I20260809 22:51:22.147462 8844 tablet_service.cc:1467] Processing CreateTablet for tablet 92f5f0501bf74a039eb756fe1fcb341f (DEFAULT_TABLE table=test-table [id=77d194743d8d496fa0d5e25685de0543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:51:22.148630 8844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92f5f0501bf74a039eb756fe1fcb341f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:51:22.160561 9205 tablet_bootstrap.cc:492] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Bootstrap starting.
I20260809 22:51:22.163344 9209 tablet_bootstrap.cc:492] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Bootstrap starting.
I20260809 22:51:22.164835 9210 tablet_bootstrap.cc:492] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Bootstrap starting.
I20260809 22:51:22.166194 9205 tablet_bootstrap.cc:654] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Neither blocks nor log segments found. Creating new log.
I20260809 22:51:22.167899 9209 tablet_bootstrap.cc:654] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Neither blocks nor log segments found. Creating new log.
I20260809 22:51:22.167884 9205 log.cc:824] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Log is configured to *not* fsync() on all Append() calls
I20260809 22:51:22.168699 9210 tablet_bootstrap.cc:654] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Neither blocks nor log segments found. Creating new log.
I20260809 22:51:22.169297 9209 log.cc:824] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Log is configured to *not* fsync() on all Append() calls
I20260809 22:51:22.169834 9210 log.cc:824] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Log is configured to *not* fsync() on all Append() calls
I20260809 22:51:22.171736 9205 tablet_bootstrap.cc:492] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: No bootstrap required, opened a new log
I20260809 22:51:22.172051 9205 ts_tablet_manager.cc:1397] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 22:51:22.172746 9209 tablet_bootstrap.cc:492] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: No bootstrap required, opened a new log
I20260809 22:51:22.172904 9210 tablet_bootstrap.cc:492] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: No bootstrap required, opened a new log
I20260809 22:51:22.173007 9209 ts_tablet_manager.cc:1397] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 22:51:22.173293 9210 ts_tablet_manager.cc:1397] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 22:51:22.182276 9210 raft_consensus.cc:348] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.182729 9210 raft_consensus.cc:374] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:51:22.182857 9210 raft_consensus.cc:729] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e3304cd5e349749583a0fda2141d79, State: Initialized, Role: FOLLOWER
I20260809 22:51:22.183121 9205 raft_consensus.cc:348] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.183600 9205 raft_consensus.cc:374] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:51:22.183719 9205 raft_consensus.cc:729] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8577815eb6d64ed6bc0847c06be452c5, State: Initialized, Role: FOLLOWER
I20260809 22:51:22.183689 9210 consensus_queue.cc:260] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.183738 9209 raft_consensus.cc:348] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.184170 9209 raft_consensus.cc:374] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:51:22.184276 9209 raft_consensus.cc:729] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50428f80cce24381a0507d4552233dee, State: Initialized, Role: FOLLOWER
I20260809 22:51:22.184330 9205 consensus_queue.cc:260] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.184857 9209 consensus_queue.cc:260] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.190420 9205 ts_tablet_manager.cc:1428] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Time spent starting tablet: real 0.018s user 0.009s sys 0.007s
I20260809 22:51:22.191720 9166 heartbeater.cc:503] Master 127.23.131.126:41331 was elected leader, sending a full tablet report...
I20260809 22:51:22.192332 9210 ts_tablet_manager.cc:1428] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Time spent starting tablet: real 0.019s user 0.000s sys 0.020s
I20260809 22:51:22.194047 8949 heartbeater.cc:503] Master 127.23.131.126:41331 was elected leader, sending a full tablet report...
I20260809 22:51:22.194686 9209 ts_tablet_manager.cc:1428] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Time spent starting tablet: real 0.022s user 0.011s sys 0.011s
W20260809 22:51:22.299284 9171 tablet.cc:2369] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:51:22.326112 8732 tablet.cc:2369] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:51:22.429555 8951 tablet.cc:2369] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:51:22.430752 9220 raft_consensus.cc:482] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:51:22.431078 9220 raft_consensus.cc:504] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.433387 9220 leader_election.cc:288] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8577815eb6d64ed6bc0847c06be452c5 (127.23.131.65:33339), 70e3304cd5e349749583a0fda2141d79 (127.23.131.67:37151)
I20260809 22:51:22.435343 9216 raft_consensus.cc:482] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:51:22.435727 9216 raft_consensus.cc:504] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.440999 9216 leader_election.cc:288] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8577815eb6d64ed6bc0847c06be452c5 (127.23.131.65:33339), 50428f80cce24381a0507d4552233dee (127.23.131.66:39791)
I20260809 22:51:22.443733 9199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.433785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:37657 (local address 127.23.131.67:37151)
0809 22:51:22.434034 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.434043 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.435193 (+ 1150us) server_negotiation.cc:407] Connection header received
0809 22:51:22.435499 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.435507 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.435590 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.435673 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.436809 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.438002 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.440747 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.442111 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.442234 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.442339 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.443326 (+ 987us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.443479 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 22:51:22.444497 9226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.434108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:37151 (local address 127.23.131.66:37657)
0809 22:51:22.435066 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.435090 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.435323 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.435876 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.435881 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.435904 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.436613 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.436626 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.438187 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.438192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.440551 (+ 2359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.440567 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.442868 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.442874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.443079 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.443126 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.443902 (+ 776us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.444058 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":66,"thread_start_us":603,"threads_started":1}
I20260809 22:51:22.444753 9198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.433785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:55179 (local address 127.23.131.65:33339)
0809 22:51:22.434013 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.434020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.434896 (+ 876us) server_negotiation.cc:407] Connection header received
0809 22:51:22.435302 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.435311 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.435405 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.435478 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.436724 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.437791 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.441095 (+ 3304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.442720 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.442886 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.443161 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.444187 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.444392 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":115,"server-negotiator.queue_time_us":53}
I20260809 22:51:22.445694 9092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f5f0501bf74a039eb756fe1fcb341f" candidate_uuid: "50428f80cce24381a0507d4552233dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e3304cd5e349749583a0fda2141d79" is_pre_election: true
I20260809 22:51:22.446344 9092 raft_consensus.cc:2454] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50428f80cce24381a0507d4552233dee in term 0.
I20260809 22:51:22.446465 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.433724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33339 (local address 127.23.131.66:55179)
0809 22:51:22.434773 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.434798 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.435039 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.435837 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.435843 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.435873 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.436519 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.436533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.438000 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.438005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.440875 (+ 2870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.440896 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.443429 (+ 2533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.443437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.443699 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.443747 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.445372 (+ 1625us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.445717 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":29,"thread_start_us":606,"threads_started":1}
I20260809 22:51:22.447319 8767 leader_election.cc:302] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50428f80cce24381a0507d4552233dee, 70e3304cd5e349749583a0fda2141d79; no voters:
I20260809 22:51:22.447845 9220 raft_consensus.cc:2781] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:51:22.447988 9220 raft_consensus.cc:482] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:51:22.448087 9220 raft_consensus.cc:3037] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:51:22.448213 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f5f0501bf74a039eb756fe1fcb341f" candidate_uuid: "50428f80cce24381a0507d4552233dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8577815eb6d64ed6bc0847c06be452c5" is_pre_election: true
I20260809 22:51:22.448997 8659 raft_consensus.cc:2454] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50428f80cce24381a0507d4552233dee in term 0.
I20260809 22:51:22.449643 9178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.438166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33339 (local address 127.23.131.67:33199)
0809 22:51:22.438584 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.438602 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.438712 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.442052 (+ 3340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.442058 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.442094 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.442372 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.442384 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.444353 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.444358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.446699 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.446714 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.448816 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.448823 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.449067 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.449107 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.449185 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.449338 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":1}
I20260809 22:51:22.450981 9229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.439015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:33199 (local address 127.23.131.65:33339)
0809 22:51:22.441700 (+ 2685us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.441706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.441729 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:51:22.441789 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.441794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.441873 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.442532 (+ 659us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.442883 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.444193 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.447017 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.448603 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.450348 (+ 1745us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.450425 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.450493 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.450644 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":2528,"thread_start_us":2584,"threads_started":1}
I20260809 22:51:22.451737 9220 raft_consensus.cc:504] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.452106 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f5f0501bf74a039eb756fe1fcb341f" candidate_uuid: "70e3304cd5e349749583a0fda2141d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8577815eb6d64ed6bc0847c06be452c5" is_pre_election: true
I20260809 22:51:22.452358 8659 raft_consensus.cc:2454] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70e3304cd5e349749583a0fda2141d79 in term 0.
I20260809 22:51:22.453050 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f5f0501bf74a039eb756fe1fcb341f" candidate_uuid: "50428f80cce24381a0507d4552233dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8577815eb6d64ed6bc0847c06be452c5"
I20260809 22:51:22.453133 8982 leader_election.cc:302] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70e3304cd5e349749583a0fda2141d79, 8577815eb6d64ed6bc0847c06be452c5; no voters:
I20260809 22:51:22.453261 8659 raft_consensus.cc:3037] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:51:22.453342 9092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f5f0501bf74a039eb756fe1fcb341f" candidate_uuid: "50428f80cce24381a0507d4552233dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70e3304cd5e349749583a0fda2141d79"
I20260809 22:51:22.453591 9092 raft_consensus.cc:3037] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:51:22.454860 9220 leader_election.cc:288] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [CANDIDATE]: Term 1 election: Requested vote from peers 8577815eb6d64ed6bc0847c06be452c5 (127.23.131.65:33339), 70e3304cd5e349749583a0fda2141d79 (127.23.131.67:37151)
I20260809 22:51:22.456439 8659 raft_consensus.cc:2454] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50428f80cce24381a0507d4552233dee in term 1.
I20260809 22:51:22.456552 9092 raft_consensus.cc:2454] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50428f80cce24381a0507d4552233dee in term 1.
I20260809 22:51:22.456750 9216 raft_consensus.cc:2741] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260809 22:51:22.456987 8769 leader_election.cc:302] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50428f80cce24381a0507d4552233dee, 8577815eb6d64ed6bc0847c06be452c5; no voters:
I20260809 22:51:22.457286 9178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.441251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:39791 (local address 127.23.131.67:51781)
0809 22:51:22.449874 (+ 8623us) negotiation.cc:107] Waiting for socket to connect
0809 22:51:22.449896 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:51:22.450100 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:51:22.450595 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:51:22.450598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:51:22.450621 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:51:22.450761 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.450768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.452333 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.452340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.454517 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:51:22.454531 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.456249 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.456258 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:51:22.456566 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.456615 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 22:51:22.456723 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 22:51:22.456921 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8516,"thread_start_us":10084,"threads_started":1}
I20260809 22:51:22.457567 9220 raft_consensus.cc:2781] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:51:22.457974 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.442607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:51781 (local address 127.23.131.66:39791)
0809 22:51:22.442781 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.442788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.450033 (+ 7245us) server_negotiation.cc:407] Connection header received
0809 22:51:22.450217 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.450221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.450303 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.450396 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:51:22.450922 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.452135 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.454703 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.456031 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.456216 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.456317 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.457516 (+ 1199us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.457710 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 22:51:22.458421 9220 raft_consensus.cc:686] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 1 LEADER]: Becoming Leader. State: Replica: 50428f80cce24381a0507d4552233dee, State: Running, Role: LEADER
I20260809 22:51:22.459002 8884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f5f0501bf74a039eb756fe1fcb341f" candidate_uuid: "70e3304cd5e349749583a0fda2141d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50428f80cce24381a0507d4552233dee" is_pre_election: true
I20260809 22:51:22.459537 9220 consensus_queue.cc:237] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } }
I20260809 22:51:22.464433 8415 catalog_manager.cc:5495] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee reported cstate change: term changed from 0 to 1, leader changed from <none> to 50428f80cce24381a0507d4552233dee (127.23.131.66). New cstate: current_term: 1 leader_uuid: "50428f80cce24381a0507d4552233dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50428f80cce24381a0507d4552233dee" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39791 } health_report { overall_health: HEALTHY } } }
I20260809 22:51:22.515782 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.510155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.23.131.66:39791)
0809 22:51:22.510361 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.510366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.510502 (+ 136us) server_negotiation.cc:407] Connection header received
0809 22:51:22.510684 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.510688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.510781 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.510917 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:51:22.511358 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.512193 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.513519 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.513915 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.514012 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.514474 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:51:22.515054 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:51:22.515177 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.515455 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.515539 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 22:51:22.524600 9092 raft_consensus.cc:1261] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 1 FOLLOWER]: Refusing update from remote peer 50428f80cce24381a0507d4552233dee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:51:22.524691 8659 raft_consensus.cc:1261] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 1 FOLLOWER]: Refusing update from remote peer 50428f80cce24381a0507d4552233dee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:51:22.525705 9220 consensus_queue.cc:1035] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "70e3304cd5e349749583a0fda2141d79" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 37151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:51:22.526191 9232 consensus_queue.cc:1035] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "8577815eb6d64ed6bc0847c06be452c5" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:51:22.538630 9238 mvcc.cc:205] Tried to move back new op lower bound from 7316749854808948736 to 7316749854558912512. Current Snapshot: MvccSnapshot[applied={T|T < 7316749854808948736}]
I20260809 22:51:22.544821 9244 mvcc.cc:205] Tried to move back new op lower bound from 7316749854808948736 to 7316749854558912512. Current Snapshot: MvccSnapshot[applied={T|T < 7316749854808948736}]
I20260809 22:51:22.559077 8416 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:51:22.559461 8416 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:51:22.563604 8416 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d39d0de78a745b5ac2a8f6a0c970c13: Sending DeleteTablet for 3 replicas of tablet 92f5f0501bf74a039eb756fe1fcb341f
I20260809 22:51:22.564903 8844 tablet_service.cc:1514] Processing DeleteTablet for tablet 92f5f0501bf74a039eb756fe1fcb341f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:51:22 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:46568
I20260809 22:51:22.564894 9060 tablet_service.cc:1514] Processing DeleteTablet for tablet 92f5f0501bf74a039eb756fe1fcb341f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:51:22 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:43200
I20260809 22:51:22.565049 8622 tablet_service.cc:1514] Processing DeleteTablet for tablet 92f5f0501bf74a039eb756fe1fcb341f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:51:22 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:35804
I20260809 22:51:22.566042 9257 tablet_replica.cc:330] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: stopping tablet replica
I20260809 22:51:22.566097 9258 tablet_replica.cc:330] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: stopping tablet replica
I20260809 22:51:22.566555 9258 raft_consensus.cc:2229] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:51:22.566570 9257 raft_consensus.cc:2229] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:51:22.567128 9258 raft_consensus.cc:2258] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:51:22.567612 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 8517
I20260809 22:51:22.567662 9257 raft_consensus.cc:2258] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:51:22.568059 9260 tablet_replica.cc:330] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: stopping tablet replica
I20260809 22:51:22.568522 9260 raft_consensus.cc:2229] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:51:22.569038 9260 raft_consensus.cc:2258] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:51:22.570182 9257 ts_tablet_manager.cc:1905] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:51:22.571579 9260 ts_tablet_manager.cc:1905] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:51:22.572836 9258 ts_tablet_manager.cc:1905] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:51:22.578537 9257 ts_tablet_manager.cc:1918] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:51:22.578778 9257 log.cc:1196] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/92f5f0501bf74a039eb756fe1fcb341f
I20260809 22:51:22.579422 9257 ts_tablet_manager.cc:1939] T 92f5f0501bf74a039eb756fe1fcb341f P 50428f80cce24381a0507d4552233dee: Deleting consensus metadata
I20260809 22:51:22.579399 9260 ts_tablet_manager.cc:1918] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:51:22.579598 9260 log.cc:1196] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/92f5f0501bf74a039eb756fe1fcb341f
I20260809 22:51:22.580175 9260 ts_tablet_manager.cc:1939] T 92f5f0501bf74a039eb756fe1fcb341f P 8577815eb6d64ed6bc0847c06be452c5: Deleting consensus metadata
I20260809 22:51:22.581645 8395 catalog_manager.cc:4841] TS 50428f80cce24381a0507d4552233dee (127.23.131.66:39791): tablet 92f5f0501bf74a039eb756fe1fcb341f (table test-table [id=77d194743d8d496fa0d5e25685de0543]) successfully deleted
I20260809 22:51:22.582074 8395 catalog_manager.cc:4841] TS 8577815eb6d64ed6bc0847c06be452c5 (127.23.131.65:33339): tablet 92f5f0501bf74a039eb756fe1fcb341f (table test-table [id=77d194743d8d496fa0d5e25685de0543]) successfully deleted
I20260809 22:51:22.585218 9258 ts_tablet_manager.cc:1918] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:51:22.585443 9258 log.cc:1196] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/92f5f0501bf74a039eb756fe1fcb341f
I20260809 22:51:22.586055 9258 ts_tablet_manager.cc:1939] T 92f5f0501bf74a039eb756fe1fcb341f P 70e3304cd5e349749583a0fda2141d79: Deleting consensus metadata
Aug 09 22:51:22 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:51:22.588152 8390 catalog_manager.cc:4841] TS 70e3304cd5e349749583a0fda2141d79 (127.23.131.67:37151): tablet 92f5f0501bf74a039eb756fe1fcb341f (table test-table [id=77d194743d8d496fa0d5e25685de0543]) successfully deleted
I20260809 22:51:22.595968 9229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.569340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.23.131.65:33339)
0809 22:51:22.569536 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.569546 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.569725 (+ 179us) server_negotiation.cc:407] Connection header received
0809 22:51:22.570042 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.570049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.570156 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.570244 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:22.574834 (+ 4590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.576108 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.582338 (+ 6230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.583023 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.583135 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.589251 (+ 6116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:22.589269 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:22.589285 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:22.589330 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:22.592662 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.593607 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.593615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.593618 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.593769 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.594253 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.594257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.594259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.594641 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:22.594882 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.595415 (+ 533us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.595628 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 22:51:22.596771 8723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:22.692252 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 8517
I20260809 22:51:22.724244 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 8740
Aug 09 22:51:22 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:51:22.742475 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.725109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46588 (local address 127.23.131.66:39791)
0809 22:51:22.725353 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.725360 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.725382 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:51:22.725453 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.725459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.725562 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.725673 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:22.727161 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.728396 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.729625 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.730317 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.730443 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.735086 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:22.735107 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:22.735128 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:22.735177 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:22.739403 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.740236 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.740251 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.740254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.740434 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.740808 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.740813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.740817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.741293 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:22.741619 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.741770 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.742012 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 22:51:22.743358 8942 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:22.862637 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 8740
I20260809 22:51:22.887761 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 8960
Aug 09 22:51:22 dist-test-slave-92m1 krb5kdc[8344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:51:22.904112 9199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:51:22.888577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.23.131.67:37151)
0809 22:51:22.888788 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:51:22.888792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:51:22.888814 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:51:22.888925 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:51:22.888929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:51:22.888995 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:51:22.889085 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:51:22.890424 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.891195 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.892560 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:51:22.892999 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:51:22.893111 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:51:22.898058 (+ 4947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:51:22.898074 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:51:22.898091 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:51:22.898133 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:51:22.901081 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.901826 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.901833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.901835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.901992 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:51:22.902384 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:51:22.902388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:51:22.902392 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:51:22.902803 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:51:22.903076 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 22:51:22.903461 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 22:51:22.903662 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 22:51:22.904829 9161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:22.998505 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 8960
I20260809 22:51:23.025839 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 8367
I20260809 22:51:23.027088 8460 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:51:23.142809 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 8367
2026-08-09T22:51:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5271 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:51:23 dist-test-slave-92m1 krb5kdc[9273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:51:23 dist-test-slave-92m1 krb5kdc[9273](info): set up 2 sockets
Aug 09 22:51:23 dist-test-slave-92m1 krb5kdc[9273](info): commencing operation
krb5kdc: starting...
W20260809 22:51:24.533061 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:51:24 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:51:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:51:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/rangeradmin_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/rangeradmin_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/rangerlookup_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/rangerlookup_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
I20260809 22:51:25.028434 24077 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNJsjXw/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/postgres -l logfile start
2026-08-09 22:51:27.615 UTC [9313] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 22:51:27.615 UTC [9313] LOG: listening on IPv4 address "127.23.131.84", port 52475
2026-08-09 22:51:27.619 UTC [9313] LOG: listening on Unix socket "/tmp/.s.PGSQL.52475"
2026-08-09 22:51:27.645 UTC [9315] LOG: database system was shut down at 2026-08-09 22:51:26 UTC
2026-08-09 22:51:27.649 UTC [9313] LOG: database system is ready to accept connections
I20260809 22:51:28.869596 24077 mini_postgres.cc:96] Postgres bound to 52475
2026-08-09 22:51:28.899 UTC [9329] FATAL: database "slave" does not exist
127.23.131.84:52475 - accepting connections
I20260809 22:51:28.900803 24077 mini_ranger.cc:161] Starting Ranger...
I20260809 22:51:28.940086 24077 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 22:51:29.417582 24077 mini_ranger.cc:87] Created ranger Postgres database
I20260809 22:51:29.417722 24077 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-admin
2026-08-09 22:51:29,767 [I] DB FLAVOR :POSTGRES
2026-08-09 22:51:29,768 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 22:51:29,768 [I] Checking connection..
2026-08-09 22:51:29,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 22:51:30,041 [I] Checking connection passed.
2026-08-09 22:51:30,042 [I] --------- Verifying version history table ---------
2026-08-09 22:51:30,042 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 22:51:30,304 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 22:51:30,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 22:51:30,566 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 22:51:30,566 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 22:51:30,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 22:51:30.840 UTC [9429] WARNING: there is no transaction in progress
2026-08-09 22:51:30,847 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 22:51:30,848 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 22:51:31,126 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 22:51:31,127 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 22:51:31,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 22:51:31,428 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 22:51:31,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-92m1.c.gcp-upstream.internal','N') ;"
2026-08-09 22:51:31,947 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 22:51:32,195 [I] Table x_portal_user does not exist in database ranger
2026-08-09 22:51:32,195 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 22:51:32,458 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 22:51:32,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 22:51:32,710 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 22:51:32,981 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 22:51:32,981 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 22:51:33.925 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:33.941 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:33.957 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:33.972 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:33.989 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.010 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.076 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.082 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.096 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.106 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.117 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.130 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.139 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.146 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.152 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34.158 UTC [9603] WARNING: there is no transaction in progress
2026-08-09 22:51:34,739 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 22:51:34,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 22:51:35,006 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 22:51:35,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 22:51:35,263 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 22:51:35,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 22:51:35,558 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 22:51:35,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 22:51:35,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 22:51:36,087 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-92m1.c.gcp-upstream.internal';"
2026-08-09 22:51:36,353 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 22:51:36,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 22:51:36,623 [I] DB_PATCHES have already been applied
I20260809 22:51:36.630300 24077 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNJsjXw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 22:51:36.630401 24077 mini_ranger.cc:193] Using host: 127.23.131.84
I20260809 22:51:36.657282 24077 mini_ranger.cc:227] Ranger admin URL: http://127.23.131.84:54519
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 10:51:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 22:51:38.132169 24077 mini_ranger.cc:160] Time spent starting Ranger: real 9.231s user 0.003s sys 0.084s
Aug 09, 2026 10:51:59 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 10:51:59 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 10:51:59 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 10:51:59 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 10:52:00 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 22:52:00.712371 24077 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/rangerkms_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/rangerkms_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.131.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.131.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 22:52:00 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315920, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 22:52:00.969612 24077 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 22:52:01.004021 24077 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 22:52:01.884617 24077 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 22:52:01.884824 24077 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms
I20260809 22:52:01.884955 24077 mini_ranger_kms.cc:227] Using postgres at 127.23.131.84:52475
2026-08-09 22:52:02,400 [I] DB FLAVOR :POSTGRES
2026-08-09 22:52:02,400 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 22:52:02,400 [I] Checking connection
2026-08-09 22:52:02,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 22:52:02,651 [I] connection success
2026-08-09 22:52:02,651 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 22:52:02,651 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 22:52:02,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 22:52:02,906 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 22:52:02,906 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 22:52:02,907 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 22:52:02,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:52475/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 22:52:03,170 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 22:52:03.747321 24077 mini_ranger_kms.cc:310] Created kms service
I20260809 22:52:03.987187 24077 mini_ranger_kms.cc:326] Created kudu user
I20260809 22:52:04.037742 24077 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 22:52:04 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315920, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:04.458475 24077 mini_ranger_kms.cc:384] Added ranger policy
I20260809 22:52:04.458907 24077 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 22:52:04.458983 24077 mini_ranger_kms.cc:240] Using host: 127.23.131.84
I20260809 22:52:04.499255 24077 mini_ranger_kms.cc:276] Ranger KMS PID: 9918
I20260809 22:52:04.499447 24077 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.131.84:39039
Aug 09, 2026 10:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 10:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 10:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 10:52:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 10:52:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 10:52:06 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 22:52:06 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786315926, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.131.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 22:52:07 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315926, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.131.84@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:07.480610 24077 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.511s user 0.135s sys 0.450s
I20260809 22:52:07.480990 24077 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 22:52:07.481212 24077 mini_ranger_kms.cc:401] 127.23.131.84:39039/kms/v1/keys
Aug 09 22:52:07 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315926, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.131.84@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
Aug 09 22:52:10 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:52:10.355537 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45575
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45575
--ranger_config_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:39039/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:52:10.728639 10010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:52:10.728928 10010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:52:10.729110 10010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:52:10.736536 10010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:52:10.736676 10010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:52:10.736761 10010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:52:10.736879 10010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:52:10.736963 10010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:52:10.747510 10010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.131.84:39039/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45575
--ranger_config_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:52:10.748836 10010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:52:10.750204 10010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:52:10.763979 10021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:52:10.763900 10024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:52:10.764279 10010 server_base.cc:1034] running on GCE node
W20260809 22:52:10.763950 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:52:10.765398 10010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:52:10.766865 10010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:52:10.768091 10010 hybrid_clock.cc:648] HybridClock initialized: now 1786315930768033 us; error 45 us; skew 500 ppm
I20260809 22:52:10.768432 10010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:52:10 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:52:10.775071 10010 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:52:10.776701 10010 webserver.cc:460] Webserver started at http://127.23.131.126:46821/ using document root <none> and password file <none>
I20260809 22:52:10.777410 10010 fs_manager.cc:359] Metadata directory not provided
I20260809 22:52:10.777563 10010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:52:10.777877 10010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:52:10 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:10.832032 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "4b71f37104da4abe81ad57a0668d79ed"
format_stamp: "Formatted at 2026-08-09 22:52:10 on dist-test-slave-92m1"
server_key: "be314645c2c60d5ad842cf9f4f29333f"
server_key_iv: "30a493e8baa42f21e3eddac573e75811"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:10.832948 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "4b71f37104da4abe81ad57a0668d79ed"
format_stamp: "Formatted at 2026-08-09 22:52:10 on dist-test-slave-92m1"
server_key: "be314645c2c60d5ad842cf9f4f29333f"
server_key_iv: "30a493e8baa42f21e3eddac573e75811"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:10.839461 10010 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 22:52:10.858180 10039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:10.859887 10010 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 22:52:10.860121 10010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "4b71f37104da4abe81ad57a0668d79ed"
format_stamp: "Formatted at 2026-08-09 22:52:10 on dist-test-slave-92m1"
server_key: "be314645c2c60d5ad842cf9f4f29333f"
server_key_iv: "30a493e8baa42f21e3eddac573e75811"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:10.860378 10010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:52:10.883606 10010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:52:10.888273 10010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:52:10.888605 10010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:52:10.909574 10010 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:45575
I20260809 22:52:10.909595 10126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:45575 every 8 connection(s)
I20260809 22:52:10.911044 10010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:52:10.915136 10127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:52:10.919953 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 10010
I20260809 22:52:10.920185 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:52:10.920854 24077 external_mini_cluster.cc:1428] Setting key 941b6c6fe8ec2770f268e5b565031915
I20260809 22:52:10.926891 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed: Bootstrap starting.
I20260809 22:52:10.930784 10127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed: Neither blocks nor log segments found. Creating new log.
I20260809 22:52:10.932052 10127 log.cc:824] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed: Log is configured to *not* fsync() on all Append() calls
I20260809 22:52:10.935084 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed: No bootstrap required, opened a new log
Aug 09 22:52:10 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:52:10.944476 10132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:10.923015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47268 (local address 127.23.131.126:45575)
0809 22:52:10.924127 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:10.924139 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:10.924185 (+ 46us) server_negotiation.cc:407] Connection header received
0809 22:52:10.925976 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:10.925997 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:10.926378 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:10.926698 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:10.928407 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:10.929748 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:10.931624 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:10.932353 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:10.932480 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:10.937041 (+ 4561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:10.937049 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:10.937066 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:10.937111 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:10.940383 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:10.941199 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:10.941205 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:10.941211 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:10.941350 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:10.941756 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:10.941759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:10.941761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:10.942290 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:10.942537 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:10.943012 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 22:52:10.943469 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":627,"threads_started":1}
I20260809 22:52:10.944619 10127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b71f37104da4abe81ad57a0668d79ed" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45575 } }
I20260809 22:52:10.945043 10127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:52:10.945163 10127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b71f37104da4abe81ad57a0668d79ed, State: Initialized, Role: FOLLOWER
I20260809 22:52:10.945731 10127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b71f37104da4abe81ad57a0668d79ed" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45575 } }
I20260809 22:52:10.946058 10127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:52:10.946208 10127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:52:10.946408 10127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:52:10.949044 10127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b71f37104da4abe81ad57a0668d79ed" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45575 } }
I20260809 22:52:10.949631 10127 leader_election.cc:302] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b71f37104da4abe81ad57a0668d79ed; no voters:
I20260809 22:52:10.950350 10127 leader_election.cc:288] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:52:10.950496 10136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:52:10.951323 10136 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [term 1 LEADER]: Becoming Leader. State: Replica: 4b71f37104da4abe81ad57a0668d79ed, State: Running, Role: LEADER
I20260809 22:52:10.952013 10136 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b71f37104da4abe81ad57a0668d79ed" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45575 } }
I20260809 22:52:10.952683 10127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:52:10.955282 10138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b71f37104da4abe81ad57a0668d79ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b71f37104da4abe81ad57a0668d79ed" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45575 } } }
I20260809 22:52:10.955823 10138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [sys.catalog]: This master's current role is: LEADER
I20260809 22:52:10.955550 10139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b71f37104da4abe81ad57a0668d79ed. Latest consensus state: current_term: 1 leader_uuid: "4b71f37104da4abe81ad57a0668d79ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b71f37104da4abe81ad57a0668d79ed" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45575 } } }
I20260809 22:52:10.955998 10139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed [sys.catalog]: This master's current role is: LEADER
I20260809 22:52:10.964638 10143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:52:10.970914 10143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:52:10.971953 10127 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 22:52:10.992728 10143 catalog_manager.cc:1347] Generated new cluster ID: bd3b2709921e4be3a0d6f69c2c27efdc
I20260809 22:52:10.992897 10143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:52:11.007790 10143 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:52:11.010298 10143 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:52:11.019711 10143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed: Generated new TSK 0
I20260809 22:52:11.020982 10143 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:52:11.846719 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:39039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45575
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:52:12 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786315932, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 22:52:12.312037 10203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:52:12.312403 10203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:52:12.312592 10203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:52:12.322712 10203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:52:12.322965 10203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:52:12.323257 10203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:52:12.335676 10203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.131.84:39039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45575
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:52:12.337196 10203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:52:12.338604 10203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:52:12.357925 10219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:52:12.358217 10218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:52:12.364759 10203 server_base.cc:1034] running on GCE node
W20260809 22:52:12.365765 10221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:52:12.366503 10203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:52:12.370360 10203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:52:12.371644 10203 hybrid_clock.cc:648] HybridClock initialized: now 1786315932371548 us; error 97 us; skew 500 ppm
I20260809 22:52:12.372018 10203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:52:12 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315932, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:52:12.375701 10203 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:52:12.399317 10203 webserver.cc:460] Webserver started at http://127.23.131.65:45583/ using document root <none> and password file <none>
I20260809 22:52:12.400357 10203 fs_manager.cc:359] Metadata directory not provided
I20260809 22:52:12.400610 10203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:52:12.401086 10203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:52:12 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315932, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:12.422756 10203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8"
format_stamp: "Formatted at 2026-08-09 22:52:12 on dist-test-slave-92m1"
server_key: "98c4daddc8b01bd7a9b2fb3e849b98eb"
server_key_iv: "e57d7ebb3db98a21ecb976835151de7d"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:12.423776 10203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8"
format_stamp: "Formatted at 2026-08-09 22:52:12 on dist-test-slave-92m1"
server_key: "98c4daddc8b01bd7a9b2fb3e849b98eb"
server_key_iv: "e57d7ebb3db98a21ecb976835151de7d"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:12.430104 10203 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 22:52:12.451063 10229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:12.457386 10203 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260809 22:52:12.457695 10203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8"
format_stamp: "Formatted at 2026-08-09 22:52:12 on dist-test-slave-92m1"
server_key: "98c4daddc8b01bd7a9b2fb3e849b98eb"
server_key_iv: "e57d7ebb3db98a21ecb976835151de7d"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:12.457998 10203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:52:12.480512 10203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:52:12.486034 10203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:52:12.486505 10203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:52:12.487951 10203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:52:12.490023 10203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:52:12.490159 10203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:12.490321 10203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:52:12.490415 10203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:52:12 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315932, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:12.624549 10203 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:41909
I20260809 22:52:12.624620 10412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:41909 every 8 connection(s)
I20260809 22:52:12.626284 10203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:52:12.630256 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 10203
I20260809 22:52:12.630481 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:52:12.631368 24077 external_mini_cluster.cc:1428] Setting key b2eef0f7e29a31fd8398d114aeb1b2c1
Aug 09 22:52:12 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315932, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
I20260809 22:52:12.696434 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:12.636715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58575 (local address 127.23.131.126:45575)
0809 22:52:12.643598 (+ 6883us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:12.643606 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:12.656144 (+ 12538us) server_negotiation.cc:407] Connection header received
0809 22:52:12.661080 (+ 4936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:12.661087 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:12.661208 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:12.661305 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:12.663776 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:12.664914 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:12.675607 (+ 10693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:12.676288 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:12.676406 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:12.686392 (+ 9986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:12.686399 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:12.686404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:12.686451 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:12.690009 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:12.691519 (+ 1510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:12.691526 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:12.691529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:12.691702 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:12.692373 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:12.692378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:12.692381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:12.692930 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:12.693151 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:12.695754 (+ 2603us) server_negotiation.cc:299] Negotiation successful
0809 22:52:12.696025 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6736,"thread_start_us":8869,"threads_started":1}
I20260809 22:52:12.699877 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:12.637443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45575 (local address 127.23.131.65:58575)
0809 22:52:12.655899 (+ 18456us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:12.655967 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:12.659116 (+ 3149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:12.661913 (+ 2797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:12.661925 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:12.662602 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:52:12.663542 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:12.663572 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:12.665184 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:12.665189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:12.667147 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:12.667162 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:12.677708 (+ 10546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:12.677716 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:12.678083 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:12.680804 (+ 2721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:52:12.680851 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:52:12.684616 (+ 3765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:52:12.690279 (+ 5663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:52:12.690290 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:52:12.690311 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:52:12.690996 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:52:12.691908 (+ 912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:52:12.691913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:52:12.691917 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:52:12.692220 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:52:12.694656 (+ 2436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:52:12.694665 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:52:12.695239 (+ 574us) client_negotiation.cc:769] Sending connection context
0809 22:52:12.697777 (+ 2538us) client_negotiation.cc:240] Negotiation successful
0809 22:52:12.698412 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18080,"thread_start_us":17795,"threads_started":1}
I20260809 22:52:12.702149 10413 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45575
I20260809 22:52:12.702517 10413 heartbeater.cc:464] Registering TS with master...
I20260809 22:52:12.703562 10413 heartbeater.cc:511] Master 127.23.131.126:45575 requested a full tablet report, sending...
I20260809 22:52:12.706398 10069 ts_manager.cc:194] Registered new tserver with Master: 0e8bf1ac42a949fa80fabc1644ba9ca8 (127.23.131.65:41909)
I20260809 22:52:12.708688 10069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:58575
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
W20260809 22:52:12.746708 24077 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.23.131.66: real 0.102s user 0.000s sys 0.034s
I20260809 22:52:12.747972 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:39039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45575
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:52:13 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315932, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
W20260809 22:52:13.263077 10423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:52:13.263690 10423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:52:13.263885 10423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:52:13.276121 10423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:52:13.276364 10423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:52:13.276597 10423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:52:13.292891 10423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.131.84:39039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45575
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:52:13.294638 10423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:52:13.296495 10423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:52:13.316581 10436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:52:13.316184 10435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:52:13.333935 10442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:52:13.334664 10423 server_base.cc:1034] running on GCE node
I20260809 22:52:13.335640 10423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:52:13.341846 10423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:52:13.343189 10423 hybrid_clock.cc:648] HybridClock initialized: now 1786315933343076 us; error 106 us; skew 500 ppm
I20260809 22:52:13.343700 10423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:52:13 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315933, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:52:13.348277 10423 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:52:13.352003 10423 webserver.cc:460] Webserver started at http://127.23.131.66:45013/ using document root <none> and password file <none>
I20260809 22:52:13.353124 10423 fs_manager.cc:359] Metadata directory not provided
I20260809 22:52:13.353278 10423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:52:13.353665 10423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:52:13 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315933, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:13.373371 10423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "81378bef63464b259dd81af4316f11ed"
format_stamp: "Formatted at 2026-08-09 22:52:13 on dist-test-slave-92m1"
server_key: "55469c9ff9153584122ef706f43b3010"
server_key_iv: "89677e0cd17b7a6c7f50d240b8910189"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:13.374428 10423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "81378bef63464b259dd81af4316f11ed"
format_stamp: "Formatted at 2026-08-09 22:52:13 on dist-test-slave-92m1"
server_key: "55469c9ff9153584122ef706f43b3010"
server_key_iv: "89677e0cd17b7a6c7f50d240b8910189"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:13.380450 10423 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 22:52:13.398101 10465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:13.400193 10423 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 22:52:13.400458 10423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "81378bef63464b259dd81af4316f11ed"
format_stamp: "Formatted at 2026-08-09 22:52:13 on dist-test-slave-92m1"
server_key: "55469c9ff9153584122ef706f43b3010"
server_key_iv: "89677e0cd17b7a6c7f50d240b8910189"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:13.400724 10423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:52:13.427713 10423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:52:13.431978 10423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:52:13.432313 10423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:52:13.433382 10423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:52:13.434829 10423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:52:13.434957 10423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:13.435107 10423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:52:13.435182 10423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:13.477396 10423 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:39747
I20260809 22:52:13.477408 10628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:39747 every 8 connection(s)
I20260809 22:52:13.478798 10423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:52:13.487043 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 10423
I20260809 22:52:13.487267 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:52:13.487818 24077 external_mini_cluster.cc:1428] Setting key 7f6cb6b5d33f1fae3804dd2cde111a3a
Aug 09 22:52:13 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315933, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:52:13.506635 10637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:13.481630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:35131 (local address 127.23.131.126:45575)
0809 22:52:13.482166 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:13.482173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:13.483249 (+ 1076us) server_negotiation.cc:407] Connection header received
0809 22:52:13.485135 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:13.485142 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:13.485228 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:13.485362 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:13.486791 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:13.487698 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:13.489739 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:13.490337 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:13.490470 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:13.499314 (+ 8844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:13.499323 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:13.499330 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:13.499379 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:13.502970 (+ 3591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:13.503869 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:13.503875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:13.503879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:13.504015 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:13.504512 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:13.504518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:13.504521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:13.504893 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:13.505127 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:13.505882 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 22:52:13.506209 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":252,"threads_started":1}
I20260809 22:52:13.507851 10638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:13.482175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45575 (local address 127.23.131.66:35131)
0809 22:52:13.483043 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:13.483089 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:13.484846 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:13.485555 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:13.485563 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:13.485991 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:52:13.486571 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:13.486610 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:13.487863 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:13.487871 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:13.489568 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:13.489583 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:13.490553 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:13.490558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:13.490825 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:13.491628 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:52:13.491651 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:52:13.493846 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:52:13.503183 (+ 9337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:52:13.503194 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:52:13.503239 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:52:13.503735 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:52:13.504148 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:52:13.504153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:52:13.504156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:52:13.504382 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:52:13.505021 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:52:13.505030 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:52:13.505445 (+ 415us) client_negotiation.cc:769] Sending connection context
0809 22:52:13.505783 (+ 338us) client_negotiation.cc:240] Negotiation successful
0809 22:52:13.506380 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":372,"threads_started":1}
I20260809 22:52:13.509620 10631 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45575
I20260809 22:52:13.509965 10631 heartbeater.cc:464] Registering TS with master...
I20260809 22:52:13.510787 10631 heartbeater.cc:511] Master 127.23.131.126:45575 requested a full tablet report, sending...
I20260809 22:52:13.512653 10069 ts_manager.cc:194] Registered new tserver with Master: 81378bef63464b259dd81af4316f11ed (127.23.131.66:39747)
I20260809 22:52:13.513943 10069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:35131
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:52:13.570842 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:39039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45575
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:52:13.713246 10413 heartbeater.cc:503] Master 127.23.131.126:45575 was elected leader, sending a full tablet report...
W20260809 22:52:13.942035 10642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:52:13.942358 10642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:52:13.942515 10642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:52:13.950277 10642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:52:13.950412 10642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:52:13.950605 10642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:52:13.961495 10642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.131.84:39039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45575
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:52:13.962841 10642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:52:13.964543 10642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:52:13.979053 10648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:52:13.979115 10649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:52:13.979709 10651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:52:13.980114 10642 server_base.cc:1034] running on GCE node
I20260809 22:52:13.980854 10642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:52:13.981997 10642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:52:13.983327 10642 hybrid_clock.cc:648] HybridClock initialized: now 1786315933983282 us; error 38 us; skew 500 ppm
I20260809 22:52:13.983765 10642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:52:13 dist-test-slave-92m1 krb5kdc[9273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315933, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:52:13.987186 10642 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:52:13.989831 10642 webserver.cc:460] Webserver started at http://127.23.131.67:43419/ using document root <none> and password file <none>
I20260809 22:52:13.990573 10642 fs_manager.cc:359] Metadata directory not provided
I20260809 22:52:13.990708 10642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:52:13.991062 10642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:52:13 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315933, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:14.011540 10642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "11d3e4e6de334d6abde752aa2ddc953b"
format_stamp: "Formatted at 2026-08-09 22:52:14 on dist-test-slave-92m1"
server_key: "dbb7f42ad309dbc11f69df86e3e29267"
server_key_iv: "5f07c5f3736e01ff25b17dd454b342fd"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:14.012923 10642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "11d3e4e6de334d6abde752aa2ddc953b"
format_stamp: "Formatted at 2026-08-09 22:52:14 on dist-test-slave-92m1"
server_key: "dbb7f42ad309dbc11f69df86e3e29267"
server_key_iv: "5f07c5f3736e01ff25b17dd454b342fd"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:14.019677 10642 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 22:52:14.036718 10661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:14.038334 10642 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 22:52:14.038550 10642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "11d3e4e6de334d6abde752aa2ddc953b"
format_stamp: "Formatted at 2026-08-09 22:52:14 on dist-test-slave-92m1"
server_key: "dbb7f42ad309dbc11f69df86e3e29267"
server_key_iv: "5f07c5f3736e01ff25b17dd454b342fd"
server_key_version: "kuduclusterkey@0"
I20260809 22:52:14.038806 10642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:52:14.059659 10642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:52:14.064097 10642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:52:14.064471 10642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:52:14.065644 10642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:52:14.067255 10642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:52:14.067348 10642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:14.067497 10642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:52:14.067559 10642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:52:14.104069 10642 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:43995
I20260809 22:52:14.104117 10823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:43995 every 8 connection(s)
I20260809 22:52:14.105579 10642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:52:14.107528 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 10642
I20260809 22:52:14.107738 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:52:14.108366 24077 external_mini_cluster.cc:1428] Setting key f19dde00f923f1eb3543f5acc9c8b84d
Aug 09 22:52:14 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315933, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:52:14.126479 10826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.108583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:60191 (local address 127.23.131.126:45575)
0809 22:52:14.109187 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.109196 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.110479 (+ 1283us) server_negotiation.cc:407] Connection header received
0809 22:52:14.112391 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.112395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.112471 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.112568 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:14.113944 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.114647 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.116283 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.116721 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.116811 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.120194 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:14.120198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:14.120201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:14.120231 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:14.123335 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.124081 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.124086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.124091 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.124261 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.124744 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.124749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.124753 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.125060 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:14.125221 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.125892 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.126121 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":270,"threads_started":1}
I20260809 22:52:14.127535 10832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.109281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45575 (local address 127.23.131.67:60191)
0809 22:52:14.110172 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:14.110226 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:14.112144 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:14.112755 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:14.112764 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:14.113193 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:52:14.113772 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.113789 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.114831 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.114835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.116144 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.116157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.116900 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.116905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.117101 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.117801 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:52:14.117823 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:52:14.120006 (+ 2183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:52:14.123466 (+ 3460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:52:14.123476 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:52:14.123494 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:52:14.123940 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:52:14.124365 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:52:14.124370 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:52:14.124374 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:52:14.124592 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:52:14.125198 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:52:14.125206 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:52:14.125546 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 22:52:14.125801 (+ 255us) client_negotiation.cc:240] Negotiation successful
0809 22:52:14.126304 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":384,"threads_started":1}
I20260809 22:52:14.128935 10824 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45575
I20260809 22:52:14.129261 10824 heartbeater.cc:464] Registering TS with master...
I20260809 22:52:14.129976 10824 heartbeater.cc:511] Master 127.23.131.126:45575 requested a full tablet report, sending...
I20260809 22:52:14.131458 10069 ts_manager.cc:194] Registered new tserver with Master: 11d3e4e6de334d6abde752aa2ddc953b (127.23.131.67:43995)
I20260809 22:52:14.132284 10069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:60191
I20260809 22:52:14.136670 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:52:14.155097 10826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.141441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.23.131.126:45575)
0809 22:52:14.141682 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.141691 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.142062 (+ 371us) server_negotiation.cc:407] Connection header received
0809 22:52:14.142303 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.142309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.142399 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.142538 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:14.144350 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.145060 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.146417 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.146903 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.147049 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.149632 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:14.149636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:14.149640 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:14.149676 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:14.152305 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.153054 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.153060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.153066 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.153237 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.153643 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.153649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.153652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.153949 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:14.154212 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.154545 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.154781 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:52:14.159543 10069 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:52:14.167508 10069 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:52:14.210405 10849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.180474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:39747 (local address 127.0.0.1:57084)
0809 22:52:14.201307 (+ 20833us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:14.201326 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:14.201573 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:14.202418 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:14.202426 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:14.202457 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:52:14.202966 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.202979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.204559 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.204564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.207117 (+ 2553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.207131 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.209361 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.209367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.209575 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.209630 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 22:52:14.209784 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 22:52:14.209975 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20666,"mutex_wait_us":200,"thread_start_us":20259,"threads_started":1}
I20260809 22:52:14.210434 10851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.180934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57084 (local address 127.23.131.66:39747)
0809 22:52:14.181653 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.181666 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.201452 (+ 19786us) server_negotiation.cc:407] Connection header received
0809 22:52:14.201785 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.201798 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.202118 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.202325 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:52:14.203157 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.204408 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.207296 (+ 2888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.208878 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.209001 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.209212 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.209858 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.210046 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":980,"threads_started":1}
I20260809 22:52:14.211440 10846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.181464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:43995 (local address 127.0.0.1:46680)
0809 22:52:14.202082 (+ 20618us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:14.202102 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:14.202247 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:14.203102 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:14.203106 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:14.203129 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:52:14.204660 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.204674 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.206576 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.206582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.208552 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.208568 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.210531 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.210537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.210729 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.210775 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 22:52:14.210859 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 22:52:14.210991 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20115,"mutex_wait_us":58,"thread_start_us":18102,"threads_started":1}
I20260809 22:52:14.211644 10852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.180478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41909 (local address 127.0.0.1:48984)
0809 22:52:14.200185 (+ 19707us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:14.200261 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:14.200538 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:14.202772 (+ 2234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:14.202781 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:14.202806 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:52:14.204259 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.204275 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.206443 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.206447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.208685 (+ 2238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.208700 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.210789 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.210794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.210973 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.211001 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 22:52:14.211071 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 22:52:14.211230 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19320,"mutex_wait_us":6,"thread_start_us":20938,"threads_started":1}
I20260809 22:52:14.212359 10847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.180624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48984 (local address 127.23.131.65:41909)
0809 22:52:14.202155 (+ 21531us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.202166 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.202196 (+ 30us) server_negotiation.cc:407] Connection header received
0809 22:52:14.202293 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.202303 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.202557 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.202764 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:52:14.204668 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.206276 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.208891 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.210317 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.210460 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.210794 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.211865 (+ 1071us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.212013 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21346,"thread_start_us":21180,"threads_started":1}
I20260809 22:52:14.212443 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.182283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46680 (local address 127.23.131.67:43995)
0809 22:52:14.197675 (+ 15392us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.197690 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.202249 (+ 4559us) server_negotiation.cc:407] Connection header received
0809 22:52:14.202474 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.202481 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.202697 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.202883 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:52:14.204935 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.206427 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.208749 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.210007 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.210138 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.210368 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.210933 (+ 565us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.211122 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15081,"thread_start_us":15418,"threads_started":1}
I20260809 22:52:14.214893 10542 tablet_service.cc:1467] Processing CreateTablet for tablet 84f6da1bdfe54b84bfc28cc60af566f8 (DEFAULT_TABLE table=test-table [id=7b88e739e93e451b8f958686ff6c876b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:52:14.215476 10739 tablet_service.cc:1467] Processing CreateTablet for tablet 84f6da1bdfe54b84bfc28cc60af566f8 (DEFAULT_TABLE table=test-table [id=7b88e739e93e451b8f958686ff6c876b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:52:14.216449 10542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84f6da1bdfe54b84bfc28cc60af566f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:52:14.216665 10739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84f6da1bdfe54b84bfc28cc60af566f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:52:14.217803 10312 tablet_service.cc:1467] Processing CreateTablet for tablet 84f6da1bdfe54b84bfc28cc60af566f8 (DEFAULT_TABLE table=test-table [id=7b88e739e93e451b8f958686ff6c876b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:52:14.219163 10312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84f6da1bdfe54b84bfc28cc60af566f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:52:14.228073 10854 tablet_bootstrap.cc:492] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Bootstrap starting.
I20260809 22:52:14.231056 10857 tablet_bootstrap.cc:492] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Bootstrap starting.
I20260809 22:52:14.232187 10854 tablet_bootstrap.cc:654] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Neither blocks nor log segments found. Creating new log.
I20260809 22:52:14.233440 10858 tablet_bootstrap.cc:492] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Bootstrap starting.
I20260809 22:52:14.233559 10854 log.cc:824] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Log is configured to *not* fsync() on all Append() calls
I20260809 22:52:14.235478 10857 tablet_bootstrap.cc:654] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Neither blocks nor log segments found. Creating new log.
I20260809 22:52:14.236763 10858 tablet_bootstrap.cc:654] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Neither blocks nor log segments found. Creating new log.
I20260809 22:52:14.236763 10857 log.cc:824] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Log is configured to *not* fsync() on all Append() calls
I20260809 22:52:14.237178 10854 tablet_bootstrap.cc:492] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: No bootstrap required, opened a new log
I20260809 22:52:14.237525 10854 ts_tablet_manager.cc:1397] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260809 22:52:14.237980 10858 log.cc:824] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Log is configured to *not* fsync() on all Append() calls
I20260809 22:52:14.240568 10857 tablet_bootstrap.cc:492] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: No bootstrap required, opened a new log
I20260809 22:52:14.240907 10857 ts_tablet_manager.cc:1397] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260809 22:52:14.241310 10858 tablet_bootstrap.cc:492] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: No bootstrap required, opened a new log
I20260809 22:52:14.241575 10858 ts_tablet_manager.cc:1397] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 22:52:14.248555 10854 raft_consensus.cc:348] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.248711 10858 raft_consensus.cc:348] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.249039 10854 raft_consensus.cc:374] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:52:14.249068 10858 raft_consensus.cc:374] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:52:14.249156 10858 raft_consensus.cc:729] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8bf1ac42a949fa80fabc1644ba9ca8, State: Initialized, Role: FOLLOWER
I20260809 22:52:14.249176 10854 raft_consensus.cc:729] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d3e4e6de334d6abde752aa2ddc953b, State: Initialized, Role: FOLLOWER
I20260809 22:52:14.249809 10858 consensus_queue.cc:260] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.249830 10854 consensus_queue.cc:260] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.252714 10857 raft_consensus.cc:348] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.253170 10857 raft_consensus.cc:374] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:52:14.253288 10857 raft_consensus.cc:729] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81378bef63464b259dd81af4316f11ed, State: Initialized, Role: FOLLOWER
I20260809 22:52:14.253927 10857 consensus_queue.cc:260] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.255131 10631 heartbeater.cc:503] Master 127.23.131.126:45575 was elected leader, sending a full tablet report...
I20260809 22:52:14.255947 10857 ts_tablet_manager.cc:1428] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
I20260809 22:52:14.257081 10858 ts_tablet_manager.cc:1428] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Time spent starting tablet: real 0.015s user 0.007s sys 0.004s
I20260809 22:52:14.258106 10824 heartbeater.cc:503] Master 127.23.131.126:45575 was elected leader, sending a full tablet report...
I20260809 22:52:14.258726 10854 ts_tablet_manager.cc:1428] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Time spent starting tablet: real 0.021s user 0.020s sys 0.000s
W20260809 22:52:14.357371 10825 tablet.cc:2369] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:52:14.392741 10415 tablet.cc:2369] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:52:14.404923 10868 raft_consensus.cc:482] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:52:14.405308 10868 raft_consensus.cc:504] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.407234 10868 leader_election.cc:288] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e8bf1ac42a949fa80fabc1644ba9ca8 (127.23.131.65:41909), 81378bef63464b259dd81af4316f11ed (127.23.131.66:39747)
I20260809 22:52:14.413463 10832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.407627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41909 (local address 127.23.131.67:54771)
0809 22:52:14.408204 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:14.408229 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:14.408411 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:14.408791 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:14.408796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:14.408836 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:52:14.409058 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.409067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.410111 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.410117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.411528 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.411540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.412675 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.412681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.412877 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.412902 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 22:52:14.413014 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 22:52:14.413162 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426}
I20260809 22:52:14.413537 10847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.407618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:54771 (local address 127.23.131.65:41909)
0809 22:52:14.407894 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.407903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.408326 (+ 423us) server_negotiation.cc:407] Connection header received
0809 22:52:14.408579 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.408583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.408647 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.408766 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:52:14.409210 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.409955 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.411691 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.412488 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.412694 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.412776 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.413045 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.413187 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:52:14.414666 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.407880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:39747 (local address 127.23.131.67:35041)
0809 22:52:14.409106 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0809 22:52:14.409121 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 22:52:14.409267 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:52:14.409610 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:52:14.409615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:52:14.409639 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:52:14.409984 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.409995 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.411020 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.411026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.412444 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:52:14.412456 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.414068 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.414075 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:52:14.414245 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.414268 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 22:52:14.414342 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 22:52:14.414432 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1105,"thread_start_us":848,"threads_started":1}
I20260809 22:52:14.414898 10851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.407964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:35041 (local address 127.23.131.66:39747)
0809 22:52:14.408151 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.408155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.409222 (+ 1067us) server_negotiation.cc:407] Connection header received
0809 22:52:14.409429 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.409433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.409494 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.409594 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:52:14.410167 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.410862 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.412732 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.413786 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.414018 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.414077 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.414423 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.414585 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:52:14.414855 10342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84f6da1bdfe54b84bfc28cc60af566f8" candidate_uuid: "11d3e4e6de334d6abde752aa2ddc953b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" is_pre_election: true
I20260809 22:52:14.415576 10342 raft_consensus.cc:2454] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d3e4e6de334d6abde752aa2ddc953b in term 0.
I20260809 22:52:14.416126 10570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84f6da1bdfe54b84bfc28cc60af566f8" candidate_uuid: "11d3e4e6de334d6abde752aa2ddc953b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81378bef63464b259dd81af4316f11ed" is_pre_election: true
I20260809 22:52:14.416450 10663 leader_election.cc:302] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8bf1ac42a949fa80fabc1644ba9ca8, 11d3e4e6de334d6abde752aa2ddc953b; no voters:
I20260809 22:52:14.416694 10570 raft_consensus.cc:2454] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d3e4e6de334d6abde752aa2ddc953b in term 0.
I20260809 22:52:14.416947 10868 raft_consensus.cc:2781] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:52:14.417130 10868 raft_consensus.cc:482] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:52:14.417264 10868 raft_consensus.cc:3037] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:52:14.419775 10868 raft_consensus.cc:504] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.420367 10868 leader_election.cc:288] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [CANDIDATE]: Term 1 election: Requested vote from peers 0e8bf1ac42a949fa80fabc1644ba9ca8 (127.23.131.65:41909), 81378bef63464b259dd81af4316f11ed (127.23.131.66:39747)
I20260809 22:52:14.420843 10342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84f6da1bdfe54b84bfc28cc60af566f8" candidate_uuid: "11d3e4e6de334d6abde752aa2ddc953b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8"
I20260809 22:52:14.420910 10570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84f6da1bdfe54b84bfc28cc60af566f8" candidate_uuid: "11d3e4e6de334d6abde752aa2ddc953b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81378bef63464b259dd81af4316f11ed"
I20260809 22:52:14.421060 10342 raft_consensus.cc:3037] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:52:14.421159 10570 raft_consensus.cc:3037] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:52:14.423448 10342 raft_consensus.cc:2454] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d3e4e6de334d6abde752aa2ddc953b in term 1.
I20260809 22:52:14.423586 10570 raft_consensus.cc:2454] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d3e4e6de334d6abde752aa2ddc953b in term 1.
I20260809 22:52:14.423907 10663 leader_election.cc:302] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e8bf1ac42a949fa80fabc1644ba9ca8, 11d3e4e6de334d6abde752aa2ddc953b; no voters:
I20260809 22:52:14.424221 10868 raft_consensus.cc:2781] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:52:14.424696 10868 raft_consensus.cc:686] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 1 LEADER]: Becoming Leader. State: Replica: 11d3e4e6de334d6abde752aa2ddc953b, State: Running, Role: LEADER
I20260809 22:52:14.425195 10868 consensus_queue.cc:237] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } }
I20260809 22:52:14.430204 10069 catalog_manager.cc:5495] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d3e4e6de334d6abde752aa2ddc953b (127.23.131.67). New cstate: current_term: 1 leader_uuid: "11d3e4e6de334d6abde752aa2ddc953b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d3e4e6de334d6abde752aa2ddc953b" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43995 } health_report { overall_health: HEALTHY } } }
I20260809 22:52:14.450716 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.445477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.23.131.67:43995)
0809 22:52:14.445690 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.445695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.445796 (+ 101us) server_negotiation.cc:407] Connection header received
0809 22:52:14.446011 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.446015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.446096 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.446224 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:52:14.446577 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.447378 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.448795 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.449199 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.449287 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.449751 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:52:14.450253 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:52:14.450358 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.450443 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.450509 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 22:52:14.459271 10570 raft_consensus.cc:1261] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 1 FOLLOWER]: Refusing update from remote peer 11d3e4e6de334d6abde752aa2ddc953b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:52:14.459277 10342 raft_consensus.cc:1261] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 1 FOLLOWER]: Refusing update from remote peer 11d3e4e6de334d6abde752aa2ddc953b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:52:14.460271 10871 consensus_queue.cc:1035] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e8bf1ac42a949fa80fabc1644ba9ca8" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:52:14.460716 10868 consensus_queue.cc:1035] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81378bef63464b259dd81af4316f11ed" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:52:14.480856 10875 mvcc.cc:205] Tried to move back new op lower bound from 7316750067534651392 to 7316750067409276928. Current Snapshot: MvccSnapshot[applied={T|T < 7316750067534651392}]
I20260809 22:52:14.497102 10069 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:52:14.497383 10069 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:52:14.501623 10069 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b71f37104da4abe81ad57a0668d79ed: Sending DeleteTablet for 3 replicas of tablet 84f6da1bdfe54b84bfc28cc60af566f8
I20260809 22:52:14.502970 10312 tablet_service.cc:1514] Processing DeleteTablet for tablet 84f6da1bdfe54b84bfc28cc60af566f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:52:14 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:48984
I20260809 22:52:14.503240 10542 tablet_service.cc:1514] Processing DeleteTablet for tablet 84f6da1bdfe54b84bfc28cc60af566f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:52:14 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:57084
I20260809 22:52:14.504498 10739 tablet_service.cc:1514] Processing DeleteTablet for tablet 84f6da1bdfe54b84bfc28cc60af566f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:52:14 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:46680
I20260809 22:52:14.506584 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 10203
I20260809 22:52:14.514226 10889 tablet_replica.cc:330] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: stopping tablet replica
I20260809 22:52:14.515040 10889 raft_consensus.cc:2229] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:52:14.515930 10889 raft_consensus.cc:2258] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:52:14.517005 10888 tablet_replica.cc:330] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: stopping tablet replica
I20260809 22:52:14.517742 10890 tablet_replica.cc:330] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: stopping tablet replica
I20260809 22:52:14.518344 10888 raft_consensus.cc:2229] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:52:14.518965 10888 raft_consensus.cc:2258] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:52:14.519565 10890 raft_consensus.cc:2229] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:52:14.520357 10890 raft_consensus.cc:2258] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:52:14.521124 10889 ts_tablet_manager.cc:1905] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:52:14.521143 10888 ts_tablet_manager.cc:1905] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:52:14.528195 10890 ts_tablet_manager.cc:1905] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:52:14.528635 10888 ts_tablet_manager.cc:1918] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:52:14.528898 10888 log.cc:1196] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/84f6da1bdfe54b84bfc28cc60af566f8
I20260809 22:52:14.529551 10888 ts_tablet_manager.cc:1939] T 84f6da1bdfe54b84bfc28cc60af566f8 P 0e8bf1ac42a949fa80fabc1644ba9ca8: Deleting consensus metadata
Aug 09 22:52:14 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:52:14.531692 10041 catalog_manager.cc:4841] TS 0e8bf1ac42a949fa80fabc1644ba9ca8 (127.23.131.65:41909): tablet 84f6da1bdfe54b84bfc28cc60af566f8 (table test-table [id=7b88e739e93e451b8f958686ff6c876b]) successfully deleted
I20260809 22:52:14.534698 10889 ts_tablet_manager.cc:1918] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:52:14.534972 10889 log.cc:1196] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/84f6da1bdfe54b84bfc28cc60af566f8
I20260809 22:52:14.535614 10889 ts_tablet_manager.cc:1939] T 84f6da1bdfe54b84bfc28cc60af566f8 P 81378bef63464b259dd81af4316f11ed: Deleting consensus metadata
I20260809 22:52:14.536506 10890 ts_tablet_manager.cc:1918] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:52:14.536824 10890 log.cc:1196] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/84f6da1bdfe54b84bfc28cc60af566f8
I20260809 22:52:14.537606 10890 ts_tablet_manager.cc:1939] T 84f6da1bdfe54b84bfc28cc60af566f8 P 11d3e4e6de334d6abde752aa2ddc953b: Deleting consensus metadata
I20260809 22:52:14.537757 10047 catalog_manager.cc:4841] TS 81378bef63464b259dd81af4316f11ed (127.23.131.66:39747): tablet 84f6da1bdfe54b84bfc28cc60af566f8 (table test-table [id=7b88e739e93e451b8f958686ff6c876b]) successfully deleted
I20260809 22:52:14.539353 10847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.508457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54782 (local address 127.23.131.65:41909)
0809 22:52:14.508707 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.508716 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.517967 (+ 9251us) server_negotiation.cc:407] Connection header received
0809 22:52:14.518277 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.518283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.518385 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.518464 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:14.521052 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.522244 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.524375 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.525078 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.525190 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.531143 (+ 5953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:14.531160 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:14.531178 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:14.531264 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:14.535476 (+ 4212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.536640 (+ 1164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.536661 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.536665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.536834 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.537343 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.537351 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.537355 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.537845 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:14.538156 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.538650 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.538889 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 22:52:14.539425 10046 catalog_manager.cc:4841] TS 11d3e4e6de334d6abde752aa2ddc953b (127.23.131.67:43995): tablet 84f6da1bdfe54b84bfc28cc60af566f8 (table test-table [id=7b88e739e93e451b8f958686ff6c876b]) successfully deleted
I20260809 22:52:14.540414 10407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:52:14.633708 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 10203
I20260809 22:52:14.670258 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 10423
Aug 09 22:52:14 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:52:14.686622 10851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.671236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33474 (local address 127.23.131.66:39747)
0809 22:52:14.671442 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.671448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.671470 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:52:14.671629 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.671639 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.671705 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.671825 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:14.673217 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.673961 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.675262 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.675685 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.675828 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.680521 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:14.680540 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:14.680557 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:14.680596 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:14.683675 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.684438 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.684445 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.684448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.684581 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.684974 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.684979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.684984 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.685389 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:14.685703 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.686017 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.686263 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 22:52:14.687474 10622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:52:14.780954 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 10423
I20260809 22:52:14.804318 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 10642
Aug 09 22:52:14 dist-test-slave-92m1 krb5kdc[9273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:52:14.822263 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:52:14.805199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51230 (local address 127.23.131.67:43995)
0809 22:52:14.805389 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 22:52:14.805396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:52:14.805504 (+ 108us) server_negotiation.cc:407] Connection header received
0809 22:52:14.805723 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:52:14.805729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:52:14.805850 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:52:14.805967 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:52:14.807419 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.808232 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.809748 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:52:14.810227 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:52:14.810374 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:52:14.815586 (+ 5212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:52:14.815607 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:52:14.815624 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:52:14.815683 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:52:14.818927 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.819896 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.819904 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.819906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.820079 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:52:14.820531 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:52:14.820535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:52:14.820537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:52:14.820925 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:52:14.821291 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0809 22:52:14.821629 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 22:52:14.821885 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 22:52:14.823050 10818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:52:14.952035 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 10642
I20260809 22:52:14.982426 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 10010
I20260809 22:52:14.983809 10120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:52:15.100623 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 10010
I20260809 22:52:15.135465 24077 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 22:52:15.482599 24077 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 22:52:15.482882 24077 mini_ranger.cc:66] Stopping Ranger...
I20260809 22:52:15.839341 24077 mini_ranger.cc:68] Stopped Ranger
2026-08-09 22:52:15.839 UTC [9313] LOG: received smart shutdown request
2026-08-09 22:52:15.844 UTC [9313] LOG: background worker "logical replication launcher" (PID 9325) exited with exit code 1
2026-08-09 22:52:15.844 UTC [9316] LOG: shutting down
2026-08-09 22:52:16.008 UTC [9313] LOG: database system is shut down
2026-08-09T22:52:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (52997 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:52:16 dist-test-slave-92m1 krb5kdc[10909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:52:16 dist-test-slave-92m1 krb5kdc[10909](info): set up 2 sockets
Aug 09 22:52:16 dist-test-slave-92m1 krb5kdc[10909](info): commencing operation
krb5kdc: starting...
W20260809 22:52:17.535137 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:52:17 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:52:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:52:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/rangeradmin_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/rangeradmin_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/rangerlookup_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/rangerlookup_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
I20260809 22:52:18.022313 24077 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNJsjXw/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/postgres -l logfile start
2026-08-09 22:52:20.550 UTC [10959] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 22:52:20.550 UTC [10959] LOG: listening on IPv4 address "127.23.131.84", port 58043
2026-08-09 22:52:20.554 UTC [10959] LOG: listening on Unix socket "/tmp/.s.PGSQL.58043"
2026-08-09 22:52:20.575 UTC [10963] LOG: database system was shut down at 2026-08-09 22:52:19 UTC
2026-08-09 22:52:20.579 UTC [10959] LOG: database system is ready to accept connections
I20260809 22:52:21.792284 24077 mini_postgres.cc:96] Postgres bound to 58043
2026-08-09 22:52:21.821 UTC [10976] FATAL: database "slave" does not exist
127.23.131.84:58043 - accepting connections
I20260809 22:52:21.822310 24077 mini_ranger.cc:161] Starting Ranger...
I20260809 22:52:21.859905 24077 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 22:52:22.365584 24077 mini_ranger.cc:87] Created ranger Postgres database
I20260809 22:52:22.365712 24077 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-admin
2026-08-09 22:52:22,682 [I] DB FLAVOR :POSTGRES
2026-08-09 22:52:22,682 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 22:52:22,682 [I] Checking connection..
2026-08-09 22:52:22,682 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 22:52:22,955 [I] Checking connection passed.
2026-08-09 22:52:22,956 [I] --------- Verifying version history table ---------
2026-08-09 22:52:22,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 22:52:23,228 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 22:52:23,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 22:52:23,486 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 22:52:23,487 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 22:52:23,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 22:52:23.765 UTC [11081] WARNING: there is no transaction in progress
2026-08-09 22:52:23,775 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 22:52:23,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 22:52:24,050 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 22:52:24,051 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 22:52:24,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 22:52:24,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 22:52:24,583 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-92m1.c.gcp-upstream.internal','N') ;"
2026-08-09 22:52:24,823 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 22:52:25,067 [I] Table x_portal_user does not exist in database ranger
2026-08-09 22:52:25,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 22:52:25,335 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 22:52:25,335 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 22:52:25,594 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 22:52:25,871 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 22:52:25,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 22:52:26.876 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:26.892 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:26.909 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:26.925 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:26.941 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:26.959 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.018 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.025 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.039 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.049 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.060 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.075 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.085 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.092 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.099 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27.106 UTC [11253] WARNING: there is no transaction in progress
2026-08-09 22:52:27,750 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 22:52:27,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 22:52:28,014 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 22:52:28,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 22:52:28,288 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 22:52:28,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 22:52:28,563 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 22:52:28,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 22:52:28,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 22:52:29,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-92m1.c.gcp-upstream.internal';"
2026-08-09 22:52:29,358 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 22:52:29,359 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 22:52:29,640 [I] DB_PATCHES have already been applied
I20260809 22:52:29.646966 24077 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNJsjXw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 22:52:29.647078 24077 mini_ranger.cc:193] Using host: 127.23.131.84
I20260809 22:52:29.673282 24077 mini_ranger.cc:227] Ranger admin URL: http://127.23.131.84:41295
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 10:52:30 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 22:52:31.138463 24077 mini_ranger.cc:160] Time spent starting Ranger: real 9.316s user 0.002s sys 0.080s
Aug 09, 2026 10:52:51 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 10:52:51 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 10:52:51 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 10:52:51 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 10:52:52 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 22:52:52.708187 24077 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.131.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.131.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/rangerkms_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.131.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/rangerkms_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.131.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.131.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.131.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/HTTP_127.23.131.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 22:52:52 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315972, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 22:52:52.974092 24077 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 22:52:53.008595 24077 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 22:52:53.923269 24077 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 22:52:53.923396 24077 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms
I20260809 22:52:53.923445 24077 mini_ranger_kms.cc:227] Using postgres at 127.23.131.84:58043
2026-08-09 22:52:54,333 [I] DB FLAVOR :POSTGRES
2026-08-09 22:52:54,333 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 22:52:54,334 [I] Checking connection
2026-08-09 22:52:54,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 22:52:54,577 [I] connection success
2026-08-09 22:52:54,577 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 22:52:54,577 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 22:52:54,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 22:52:54,818 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 22:52:54,819 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 22:52:54,819 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 22:52:54,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.131.84:58043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 22:52:55,098 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 22:52:55.611449 24077 mini_ranger_kms.cc:310] Created kms service
I20260809 22:52:55.821982 24077 mini_ranger_kms.cc:326] Created kudu user
I20260809 22:52:55.867986 24077 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 22:52:55 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315972, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:52:56.318032 24077 mini_ranger_kms.cc:384] Added ranger policy
I20260809 22:52:56.318411 24077 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNJsjXw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNJsjXw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 22:52:56.318486 24077 mini_ranger_kms.cc:240] Using host: 127.23.131.84
I20260809 22:52:56.345952 24077 mini_ranger_kms.cc:276] Ranger KMS PID: 11539
I20260809 22:52:56.346117 24077 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.131.84:58557
Aug 09, 2026 10:52:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 10:52:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 10:52:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 10:52:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 10:52:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 10:52:58 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 22:52:59 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786315979, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.131.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:52:59.330909 24077 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.357s user 0.076s sys 0.388s
I20260809 22:52:59.331173 24077 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 22:52:59.332006 24077 mini_ranger_kms.cc:401] 127.23.131.84:58557/kms/v1/keys
Aug 09 22:52:59 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315979, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.131.84@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
Aug 09 22:53:00 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315979, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.131.84@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
Aug 09 22:53:02 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:53:02.501430 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40423
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:40423
--ranger_config_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:02.863327 11618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:02.863638 11618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:02.863826 11618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:02.871417 11618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:02.871536 11618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:02.871634 11618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:02.871747 11618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:02.871825 11618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:02.882395 11618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.131.84:58557/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:40423
--ranger_config_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:02.883802 11618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:02.885205 11618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:02.898487 11627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:02.898567 11625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:02.898581 11629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:02.899318 11618 server_base.cc:1034] running on GCE node
I20260809 22:53:02.900077 11618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:02.901569 11618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:02.902773 11618 hybrid_clock.cc:648] HybridClock initialized: now 1786315982902730 us; error 39 us; skew 500 ppm
I20260809 22:53:02.903105 11618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:02 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:02.911746 11618 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:02.913410 11618 webserver.cc:460] Webserver started at http://127.23.131.126:45689/ using document root <none> and password file <none>
I20260809 22:53:02.914095 11618 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:02.914230 11618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:02.914566 11618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:53:02 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:02.982105 11618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c3b7ae44c4574ff78bfde9a920c6c731"
format_stamp: "Formatted at 2026-08-09 22:53:02 on dist-test-slave-92m1"
server_key: "7281921ff9d52c0814cef2cdcf8cc95a"
server_key_iv: "ba10271193be3496670489a565f415de"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:02.983350 11618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c3b7ae44c4574ff78bfde9a920c6c731"
format_stamp: "Formatted at 2026-08-09 22:53:02 on dist-test-slave-92m1"
server_key: "7281921ff9d52c0814cef2cdcf8cc95a"
server_key_iv: "ba10271193be3496670489a565f415de"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:02.990744 11618 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 22:53:03.011415 11643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:03.013141 11618 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 22:53:03.013350 11618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c3b7ae44c4574ff78bfde9a920c6c731"
format_stamp: "Formatted at 2026-08-09 22:53:02 on dist-test-slave-92m1"
server_key: "7281921ff9d52c0814cef2cdcf8cc95a"
server_key_iv: "ba10271193be3496670489a565f415de"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:03.013624 11618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:03.047645 11618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:03.053118 11618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:03.053488 11618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:03.074783 11618 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:40423
I20260809 22:53:03.074787 11718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:40423 every 8 connection(s)
I20260809 22:53:03.076292 11618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:03.079864 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 11618
I20260809 22:53:03.080142 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:53:03.081111 24077 external_mini_cluster.cc:1428] Setting key 58abb835d3ff06223ee4d8e7e5a6e370
I20260809 22:53:03.082429 11719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:03.103017 11719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Bootstrap starting.
I20260809 22:53:03.106868 11719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:03.108286 11719 log.cc:824] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:53:03 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:03.111299 11719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: No bootstrap required, opened a new log
I20260809 22:53:03.118995 11723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:03.083619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45682 (local address 127.23.131.126:40423)
0809 22:53:03.095806 (+ 12187us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:03.095828 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:03.095889 (+ 61us) server_negotiation.cc:407] Connection header received
0809 22:53:03.098733 (+ 2844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:03.098771 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:03.099408 (+ 637us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:03.099938 (+ 530us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:03.101587 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:03.103690 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:03.105601 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:03.106639 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:03.106833 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:03.111421 (+ 4588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:03.111433 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:03.111454 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:03.111498 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:03.114720 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:03.115485 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:03.115500 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:03.115506 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:03.115667 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:03.116080 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:03.116083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:03.116086 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:03.116651 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:03.117007 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:03.117456 (+ 449us) server_negotiation.cc:299] Negotiation successful
0809 22:53:03.117866 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11930,"thread_start_us":11680,"threads_started":1}
I20260809 22:53:03.119702 11719 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:03.120155 11719 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:03.120273 11719 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b7ae44c4574ff78bfde9a920c6c731, State: Initialized, Role: FOLLOWER
I20260809 22:53:03.120886 11719 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:03.121136 11719 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:03.121309 11719 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:03.121492 11719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:03.123941 11719 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:03.124421 11719 leader_election.cc:302] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3b7ae44c4574ff78bfde9a920c6c731; no voters:
I20260809 22:53:03.125125 11719 leader_election.cc:288] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:53:03.125204 11726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:03.125931 11726 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 LEADER]: Becoming Leader. State: Replica: c3b7ae44c4574ff78bfde9a920c6c731, State: Running, Role: LEADER
I20260809 22:53:03.126556 11726 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:03.128660 11719 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:03.129393 11727 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3b7ae44c4574ff78bfde9a920c6c731. Latest consensus state: current_term: 1 leader_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } } }
I20260809 22:53:03.129407 11728 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } } }
I20260809 22:53:03.129907 11727 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:03.131889 11728 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:03.132124 11741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:03.137585 11741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:03.138648 11719 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 22:53:03.170989 11741 catalog_manager.cc:1347] Generated new cluster ID: 09454eb17ad54e1c89c0a4b8c9b2f49e
I20260809 22:53:03.171245 11741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:03.182842 11741 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:53:03.184538 11741 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:03.191948 11741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Generated new TSK 0
I20260809 22:53:03.192874 11741 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:53:04.062176 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40423
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:53:04 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786315984, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 22:53:04.526047 11797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:04.526566 11797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:04.526769 11797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:04.539428 11797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:04.539618 11797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:04.539848 11797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:53:04.552754 11797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.131.84:58557/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:04.554204 11797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:04.555685 11797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:04.570379 11813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:04.570573 11811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:04.570422 11809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:04.571405 11797 server_base.cc:1034] running on GCE node
I20260809 22:53:04.572124 11797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:04.573240 11797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:04.574527 11797 hybrid_clock.cc:648] HybridClock initialized: now 1786315984574448 us; error 69 us; skew 500 ppm
I20260809 22:53:04.574894 11797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:04 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315984, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:04.582998 11797 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:53:04.592509 11797 webserver.cc:460] Webserver started at http://127.23.131.65:34429/ using document root <none> and password file <none>
I20260809 22:53:04.593655 11797 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:04.593905 11797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:04.594542 11797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:53:04 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315984, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:04.621371 11797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "551a30243fe848af8bc6acba94a1889d"
format_stamp: "Formatted at 2026-08-09 22:53:04 on dist-test-slave-92m1"
server_key: "4bd89b4e9e9532c8211c097d73135249"
server_key_iv: "4adb0e7c35f1e27d9ce484b5b378a7c8"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:04.622611 11797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "551a30243fe848af8bc6acba94a1889d"
format_stamp: "Formatted at 2026-08-09 22:53:04 on dist-test-slave-92m1"
server_key: "4bd89b4e9e9532c8211c097d73135249"
server_key_iv: "4adb0e7c35f1e27d9ce484b5b378a7c8"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:04.638350 11797 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.009s sys 0.003s
I20260809 22:53:04.671195 11821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:04.673306 11797 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.002s
I20260809 22:53:04.673599 11797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "551a30243fe848af8bc6acba94a1889d"
format_stamp: "Formatted at 2026-08-09 22:53:04 on dist-test-slave-92m1"
server_key: "4bd89b4e9e9532c8211c097d73135249"
server_key_iv: "4adb0e7c35f1e27d9ce484b5b378a7c8"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:04.673966 11797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:04.724542 11797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:04.729864 11797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:04.730283 11797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:04.731587 11797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:04.733405 11797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:04.733497 11797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:04.733610 11797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:04.733667 11797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 22:53:04 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315984, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:04.876884 11797 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:41365
I20260809 22:53:04.876919 11995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:41365 every 8 connection(s)
I20260809 22:53:04.878209 11797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:53:04.884757 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 11797
I20260809 22:53:04.884995 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:53:04.885697 24077 external_mini_cluster.cc:1428] Setting key 61f2b164b4bf18e20b36235759397863
Aug 09 22:53:04 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315984, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
I20260809 22:53:04.931012 12001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:04.882101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:45139 (local address 127.23.131.126:40423)
0809 22:53:04.882573 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:04.882579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:04.882790 (+ 211us) server_negotiation.cc:407] Connection header received
0809 22:53:04.885833 (+ 3043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:04.885839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:04.885952 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:04.886083 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:04.888278 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:04.889441 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:04.908044 (+ 18603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:04.908822 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:04.908977 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:04.922457 (+ 13480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:04.922467 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:04.922475 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:04.922528 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:04.926788 (+ 4260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:04.927902 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:04.927910 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:04.927915 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:04.928099 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:04.928760 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:04.928766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:04.928770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:04.929193 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:04.929424 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:04.930367 (+ 943us) server_negotiation.cc:299] Negotiation successful
0809 22:53:04.930621 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":893,"threads_started":1}
I20260809 22:53:04.932353 12000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:04.881671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40423 (local address 127.23.131.65:45139)
0809 22:53:04.882574 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:04.882643 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:04.885477 (+ 2834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:04.886387 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:04.886402 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:04.887123 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:04.888063 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:04.888092 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:04.891357 (+ 3265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:04.891365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:04.907801 (+ 16436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:04.907826 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:04.917167 (+ 9341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:04.917184 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:04.917598 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:04.918583 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:04.918620 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:04.922138 (+ 3518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:04.927021 (+ 4883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:04.927031 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:04.927050 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:04.927731 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:04.928257 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:04.928263 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:04.928270 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:04.928596 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:04.929507 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:04.929517 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:04.929888 (+ 371us) client_negotiation.cc:769] Sending connection context
0809 22:53:04.930261 (+ 373us) client_negotiation.cc:240] Negotiation successful
0809 22:53:04.930849 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":509,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
I20260809 22:53:04.934247 11996 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40423
I20260809 22:53:04.934597 11996 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:04.935393 11996 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:04.940528 11669 ts_manager.cc:194] Registered new tserver with Master: 551a30243fe848af8bc6acba94a1889d (127.23.131.65:41365)
I20260809 22:53:04.942731 11669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:45139
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:53:04.975441 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40423
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:53:05 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315984, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
W20260809 22:53:05.437429 12006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:05.437734 12006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:05.437952 12006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:05.445498 12006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:05.445629 12006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:05.445839 12006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:53:05.456359 12006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.131.84:58557/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:05.457731 12006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:05.459081 12006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:05.474293 12033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:05.474241 12036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:05.474910 12040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:05.475567 12006 server_base.cc:1034] running on GCE node
I20260809 22:53:05.476225 12006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:05.477339 12006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:05.478598 12006 hybrid_clock.cc:648] HybridClock initialized: now 1786315985478533 us; error 56 us; skew 500 ppm
I20260809 22:53:05.478962 12006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:05 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315985, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:05.482702 12006 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:53:05.484514 12006 webserver.cc:460] Webserver started at http://127.23.131.66:35709/ using document root <none> and password file <none>
I20260809 22:53:05.485304 12006 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:05.485451 12006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:05.485801 12006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:53:05 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315985, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:05.504923 12006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "f4b352d244814834a6f7d8bba46a6d48"
format_stamp: "Formatted at 2026-08-09 22:53:05 on dist-test-slave-92m1"
server_key: "0f2cb385d9dd269d1b3089ef1fd82f9f"
server_key_iv: "7139f5b37a2ddb754eaac11095f4f5eb"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:05.506244 12006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "f4b352d244814834a6f7d8bba46a6d48"
format_stamp: "Formatted at 2026-08-09 22:53:05 on dist-test-slave-92m1"
server_key: "0f2cb385d9dd269d1b3089ef1fd82f9f"
server_key_iv: "7139f5b37a2ddb754eaac11095f4f5eb"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:05.514014 12006 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260809 22:53:05.544086 12049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:05.546310 12006 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.004s sys 0.008s
I20260809 22:53:05.546547 12006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "f4b352d244814834a6f7d8bba46a6d48"
format_stamp: "Formatted at 2026-08-09 22:53:05 on dist-test-slave-92m1"
server_key: "0f2cb385d9dd269d1b3089ef1fd82f9f"
server_key_iv: "7139f5b37a2ddb754eaac11095f4f5eb"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:05.546885 12006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:05.566741 12006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:05.571444 12006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:05.571803 12006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:05.573006 12006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:05.574697 12006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:05.574810 12006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:05.574976 12006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:05.575054 12006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:05.618507 12006 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:33333
I20260809 22:53:05.618525 12226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:33333 every 8 connection(s)
I20260809 22:53:05.620219 12006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:53:05.626683 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 12006
I20260809 22:53:05.626883 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:53:05.627611 24077 external_mini_cluster.cc:1428] Setting key 250699aff3f70cb7311aa3c535f205b5
Aug 09 22:53:05 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315985, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:05.647603 12231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:05.623264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:35355 (local address 127.23.131.126:40423)
0809 22:53:05.623910 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:05.623916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:05.625065 (+ 1149us) server_negotiation.cc:407] Connection header received
0809 22:53:05.627552 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:05.627559 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:05.627652 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:05.627777 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:05.629961 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:05.631165 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:05.633965 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:05.634653 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:05.634806 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:05.639651 (+ 4845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:05.639659 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:05.639664 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:05.639707 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:05.643452 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:05.644541 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:05.644548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:05.644551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:05.644707 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:05.645300 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:05.645306 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:05.645309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:05.645714 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:05.645887 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:05.646875 (+ 988us) server_negotiation.cc:299] Negotiation successful
0809 22:53:05.647119 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":321,"threads_started":1}
I20260809 22:53:05.648674 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:05.623891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40423 (local address 127.23.131.66:35355)
0809 22:53:05.624802 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:05.624860 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:05.627163 (+ 2303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:05.628105 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:05.628117 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:05.628676 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:05.629578 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:05.629605 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:05.631374 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:05.631382 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:05.633785 (+ 2403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:05.633807 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:05.634921 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:05.634931 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:05.635326 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:05.636248 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:05.636289 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:05.639374 (+ 3085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:05.643642 (+ 4268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:05.643655 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:05.643676 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:05.644386 (+ 710us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:05.644837 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:05.644845 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:05.644851 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:05.645156 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:05.645877 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:05.645888 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:05.646386 (+ 498us) client_negotiation.cc:769] Sending connection context
0809 22:53:05.646764 (+ 378us) client_negotiation.cc:240] Negotiation successful
0809 22:53:05.647338 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":396,"threads_started":1}
I20260809 22:53:05.650391 12227 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40423
I20260809 22:53:05.650748 12227 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:05.651587 12227 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:05.653297 11669 ts_manager.cc:194] Registered new tserver with Master: f4b352d244814834a6f7d8bba46a6d48 (127.23.131.66:33333)
I20260809 22:53:05.654253 11669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:35355
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:53:05.706230 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40423
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:05.946790 11996 heartbeater.cc:503] Master 127.23.131.126:40423 was elected leader, sending a full tablet report...
W20260809 22:53:06.086108 12237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:06.086444 12237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:06.086596 12237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:06.094096 12237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:06.094209 12237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:06.094336 12237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:53:06.104557 12237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.131.84:58557/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:06.105878 12237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:06.107219 12237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:06.121624 12245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:06.121724 12248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:06.121701 12246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:06.123056 12237 server_base.cc:1034] running on GCE node
I20260809 22:53:06.123787 12237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:06.125190 12237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:06.126470 12237 hybrid_clock.cc:648] HybridClock initialized: now 1786315986126421 us; error 59 us; skew 500 ppm
I20260809 22:53:06.126878 12237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:06 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315986, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:06.130578 12237 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:53:06.132354 12237 webserver.cc:460] Webserver started at http://127.23.131.67:37505/ using document root <none> and password file <none>
I20260809 22:53:06.133129 12237 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:06.133277 12237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:06.133631 12237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 22:53:06 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315986, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:06.151729 12237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509"
format_stamp: "Formatted at 2026-08-09 22:53:06 on dist-test-slave-92m1"
server_key: "3fdad620e77e80ceab036b31034e032c"
server_key_iv: "dc5f79dd74df45f200c01c74dd0581c7"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:06.152981 12237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509"
format_stamp: "Formatted at 2026-08-09 22:53:06 on dist-test-slave-92m1"
server_key: "3fdad620e77e80ceab036b31034e032c"
server_key_iv: "dc5f79dd74df45f200c01c74dd0581c7"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:06.158569 12237 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:53:06.173199 12260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:06.174750 12237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:53:06.174984 12237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509"
format_stamp: "Formatted at 2026-08-09 22:53:06 on dist-test-slave-92m1"
server_key: "3fdad620e77e80ceab036b31034e032c"
server_key_iv: "dc5f79dd74df45f200c01c74dd0581c7"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:06.175249 12237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:06.199805 12237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:06.203822 12237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:06.204152 12237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:06.205173 12237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:06.206598 12237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:06.206703 12237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:06.206851 12237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:06.206938 12237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:06.241817 12237 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:38889
I20260809 22:53:06.241866 12436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:38889 every 8 connection(s)
I20260809 22:53:06.243173 12237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:53:06.252583 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 12237
I20260809 22:53:06.252808 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:53:06.253402 24077 external_mini_cluster.cc:1428] Setting key 15f0fc0acd54aae48129411b29642906
Aug 09 22:53:06 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315986, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:06.264290 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:06.245937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:54679 (local address 127.23.131.126:40423)
0809 22:53:06.246477 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:06.246481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:06.247313 (+ 832us) server_negotiation.cc:407] Connection header received
0809 22:53:06.249226 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:06.249232 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:06.249323 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:06.249442 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:06.250888 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.251764 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.253478 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.254062 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.254205 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:06.258257 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:06.258262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:06.258266 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:06.258300 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:06.261102 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.261867 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.261873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.261876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.262005 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.262449 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.262454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.262458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.262767 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:06.262918 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:06.263679 (+ 761us) server_negotiation.cc:299] Negotiation successful
0809 22:53:06.263923 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":303,"threads_started":1}
I20260809 22:53:06.265252 12440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:06.246389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40423 (local address 127.23.131.67:54679)
0809 22:53:06.247108 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:06.247153 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:06.248934 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:06.249698 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:06.249707 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:06.250149 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:06.250713 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:06.250730 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.251934 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.251938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:06.253335 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:06.253348 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.254404 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.254414 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:06.254722 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:06.255552 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:06.255611 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:06.258047 (+ 2436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:06.261285 (+ 3238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:06.261295 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:06.261312 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:06.261740 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:06.262118 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:06.262123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:06.262126 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:06.262336 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:06.262897 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:06.262905 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:06.263307 (+ 402us) client_negotiation.cc:769] Sending connection context
0809 22:53:06.263598 (+ 291us) client_negotiation.cc:240] Negotiation successful
0809 22:53:06.264141 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":281,"threads_started":1}
I20260809 22:53:06.266690 12437 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40423
I20260809 22:53:06.266981 12437 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:06.267834 12437 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:06.269397 11669 ts_manager.cc:194] Registered new tserver with Master: 2ce269ab9f8c460b9cd2e9e77d2ce509 (127.23.131.67:38889)
I20260809 22:53:06.270198 11669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:54679
I20260809 22:53:06.281839 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:53:06.283686 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 11797
Aug 09 22:53:06 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:53:06.300248 12443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:06.284581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.23.131.65:41365)
0809 22:53:06.285203 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:06.285211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:06.285236 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:53:06.285453 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:06.285461 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:06.285693 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:06.285827 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:06.287351 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.288403 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.289718 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.290259 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.290370 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:06.294602 (+ 4232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:06.294614 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:06.294629 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:06.294661 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:06.297576 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.298239 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.298246 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.298248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.298405 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.298732 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.298735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.298737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.299089 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:06.299433 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:06.299648 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 22:53:06.299853 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":310,"threads_started":1}
I20260809 22:53:06.301581 11990 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:06.386296 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 11797
I20260809 22:53:06.414412 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 12006
Aug 09 22:53:06 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:53:06.431439 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:06.415381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49546 (local address 127.23.131.66:33333)
0809 22:53:06.415992 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:06.415999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:06.416029 (+ 30us) server_negotiation.cc:407] Connection header received
0809 22:53:06.416116 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:06.416123 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:06.416345 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:06.416480 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:06.417751 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.418790 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.420378 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.420925 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.421031 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:06.425321 (+ 4290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:06.425332 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:06.425346 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:06.425387 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:06.428354 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.429275 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.429282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.429284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.429419 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.429819 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.429824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.429827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.430206 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:06.430437 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:06.430727 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 22:53:06.430948 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":338,"threads_started":1}
I20260809 22:53:06.432863 12222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:06.516244 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 12006
I20260809 22:53:06.541997 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 12237
Aug 09 22:53:06 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:53:06.560003 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:06.543200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.23.131.67:38889)
0809 22:53:06.543998 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:06.544005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:06.544034 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:53:06.544098 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:06.544104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:06.544324 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:06.544457 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:06.546010 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.547022 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.548550 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:06.549097 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:06.549200 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:06.553885 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:06.553899 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:06.553915 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:06.553955 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:06.556955 (+ 3000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.557686 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.557695 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.557697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.557831 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:06.558175 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:06.558178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:06.558180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:06.558553 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:06.558804 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:06.559333 (+ 529us) server_negotiation.cc:299] Negotiation successful
0809 22:53:06.559585 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":433,"threads_started":1}
I20260809 22:53:06.561431 12425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:06.647364 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 12237
I20260809 22:53:06.674209 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 11618
I20260809 22:53:06.675661 11713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:06.786640 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 11618
I20260809 22:53:06.824378 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40423
--webserver_interface=127.23.131.126
--webserver_port=45689
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:40423
--ranger_config_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:07.182106 12456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:07.182456 12456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:07.182637 12456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:07.190205 12456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:07.190387 12456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:07.190490 12456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:07.190596 12456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:07.190690 12456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:07.201184 12456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:40423
--ranger_config_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=45689
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:07.202565 12456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:07.204017 12456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:07.216825 12464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:07.216933 12465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:07.216836 12470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:07.218119 12456 server_base.cc:1034] running on GCE node
I20260809 22:53:07.218887 12456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:07.220388 12456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:07.221654 12456 hybrid_clock.cc:648] HybridClock initialized: now 1786315987221584 us; error 58 us; skew 500 ppm
I20260809 22:53:07.222074 12456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:07 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315987, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:07.225535 12456 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:07.227101 12456 webserver.cc:460] Webserver started at http://127.23.131.126:45689/ using document root <none> and password file <none>
I20260809 22:53:07.227802 12456 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:07.227973 12456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 22:53:07 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315987, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:07.281154 12456 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:53:07.284391 12484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:07.285806 12456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:53:07.286017 12456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c3b7ae44c4574ff78bfde9a920c6c731"
format_stamp: "Formatted at 2026-08-09 22:53:02 on dist-test-slave-92m1"
server_key: "7281921ff9d52c0814cef2cdcf8cc95a"
server_key_iv: "ba10271193be3496670489a565f415de"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:07.287038 12456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:07.310876 12456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:07.315404 12456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:07.315730 12456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:07.335482 12456 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:40423
I20260809 22:53:07.335503 12568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:40423 every 8 connection(s)
I20260809 22:53:07.337158 12456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:07.337850 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 12456
I20260809 22:53:07.338943 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:41365
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:40423
--webserver_port=34429
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:07.344619 12570 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:53:07.347946 12570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Bootstrap starting.
I20260809 22:53:07.372864 12570 log.cc:824] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:07.384886 12570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:53:07.385591 12570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Bootstrap complete.
I20260809 22:53:07.399492 12570 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:07.400731 12570 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b7ae44c4574ff78bfde9a920c6c731, State: Initialized, Role: FOLLOWER
I20260809 22:53:07.401538 12570 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:07.401823 12570 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:07.401963 12570 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:07.402148 12570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 1 FOLLOWER]: Advancing to term 2
I20260809 22:53:07.407953 12570 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:07.408623 12570 leader_election.cc:302] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3b7ae44c4574ff78bfde9a920c6c731; no voters:
I20260809 22:53:07.409328 12570 leader_election.cc:288] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 22:53:07.409487 12576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 22:53:07.410962 12576 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [term 2 LEADER]: Becoming Leader. State: Replica: c3b7ae44c4574ff78bfde9a920c6c731, State: Running, Role: LEADER
I20260809 22:53:07.411578 12576 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } }
I20260809 22:53:07.412283 12570 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:07.414127 12580 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3b7ae44c4574ff78bfde9a920c6c731. Latest consensus state: current_term: 2 leader_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } } }
I20260809 22:53:07.414500 12580 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:07.415063 12577 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7ae44c4574ff78bfde9a920c6c731" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40423 } } }
I20260809 22:53:07.415427 12577 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:07.423784 12584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:07.429731 12584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:07.431329 12584 catalog_manager.cc:1259] Loaded cluster ID: 09454eb17ad54e1c89c0a4b8c9b2f49e
I20260809 22:53:07.431475 12584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:07.435587 12584 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:07.437150 12584 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Loaded TSK: 0
I20260809 22:53:07.438746 12584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:53:07.441854 12570 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 22:53:07.861460 12573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:07.861800 12573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:07.862015 12573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:07.872509 12573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:07.872785 12573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:07.873071 12573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:53:07.889496 12573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:41365
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=34429
--tserver_master_addrs=127.23.131.126:40423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:07.891640 12573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:07.893429 12573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:07.921940 12634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:07.921985 12632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:07.923928 12639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:07.924410 12573 server_base.cc:1034] running on GCE node
I20260809 22:53:07.925263 12573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:07.926491 12573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:07.927717 12573 hybrid_clock.cc:648] HybridClock initialized: now 1786315987927647 us; error 57 us; skew 500 ppm
I20260809 22:53:07.928125 12573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:07 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315987, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:07.934731 12573 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:53:07.938683 12573 webserver.cc:460] Webserver started at http://127.23.131.65:34429/ using document root <none> and password file <none>
I20260809 22:53:07.939750 12573 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:07.939985 12573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 22:53:07 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315987, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:07.974331 12573 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.002s sys 0.011s
I20260809 22:53:07.987972 12652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:07.990424 12573 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.006s sys 0.004s
I20260809 22:53:07.990659 12573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "551a30243fe848af8bc6acba94a1889d"
format_stamp: "Formatted at 2026-08-09 22:53:04 on dist-test-slave-92m1"
server_key: "4bd89b4e9e9532c8211c097d73135249"
server_key_iv: "4adb0e7c35f1e27d9ce484b5b378a7c8"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:07.992269 12573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:08.028968 12573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:08.034966 12573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:08.035403 12573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:08.038709 12573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:08.040755 12573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:08.040999 12573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 22:53:08.041169 12573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:08.041277 12573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:08.128259 12573 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:41365
I20260809 22:53:08.128352 12821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:41365 every 8 connection(s)
I20260809 22:53:08.130432 12573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:53:08.138157 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 12573
I20260809 22:53:08.139240 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:33333
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:40423
--webserver_port=35709
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:53:08 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315987, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:08.210632 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:08.140337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40423 (local address 127.23.131.65:59389)
0809 22:53:08.172247 (+ 31910us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:08.172337 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:08.184076 (+ 11739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:08.188022 (+ 3946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:08.188033 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:08.188771 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:08.189580 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:08.189607 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.192172 (+ 2565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.192178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:08.194235 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:08.194252 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.196155 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.196162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:08.196437 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:08.197325 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:08.197360 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:08.200419 (+ 3059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:08.205182 (+ 4763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:08.205191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:08.205206 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:08.205848 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:08.206495 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:08.206500 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:08.206503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:08.206779 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:08.207993 (+ 1214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:08.208001 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:08.208384 (+ 383us) client_negotiation.cc:769] Sending connection context
0809 22:53:08.208697 (+ 313us) client_negotiation.cc:240] Negotiation successful
0809 22:53:08.209316 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31454,"thread_start_us":34783,"threads_started":1}
I20260809 22:53:08.213323 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:08.139256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:59389 (local address 127.23.131.126:40423)
0809 22:53:08.176894 (+ 37638us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:08.176918 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:08.176991 (+ 73us) server_negotiation.cc:407] Connection header received
0809 22:53:08.186124 (+ 9133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:08.186150 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:08.186692 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:08.187101 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:08.189900 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.191933 (+ 2033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.194421 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.195505 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.195667 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:08.200759 (+ 5092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:08.200770 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:08.200788 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:08.200843 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:08.204979 (+ 4136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:08.206056 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:08.206065 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:08.206074 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:08.206306 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:08.206949 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:08.206954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:08.206958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:08.207660 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:08.207848 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:08.211429 (+ 3581us) server_negotiation.cc:299] Negotiation successful
0809 22:53:08.211909 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37249,"thread_start_us":43846,"threads_started":1}
I20260809 22:53:08.217077 12822 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40423
I20260809 22:53:08.217525 12822 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:08.218617 12822 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
W20260809 22:53:08.222321 12822 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:40423 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 22:53:08.222666 12822 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:08.223088 12822 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:08.224686 12822 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:08.225078 12822 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
W20260809 22:53:08.226284 12822 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 22:53:08.563325 12827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:08.563634 12827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:08.563795 12827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:08.571838 12827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:08.571947 12827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:08.572116 12827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:53:08.585350 12827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:33333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=35709
--tserver_master_addrs=127.23.131.126:40423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:08.586752 12827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:08.588143 12827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:08.609774 12856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:08.613140 12857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:08.622375 12827 server_base.cc:1034] running on GCE node
W20260809 22:53:08.623353 12859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:08.624311 12827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:08.625774 12827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:08.627035 12827 hybrid_clock.cc:648] HybridClock initialized: now 1786315988626957 us; error 54 us; skew 500 ppm
I20260809 22:53:08.627454 12827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:08 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315988, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:08.631858 12827 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:53:08.634544 12827 webserver.cc:460] Webserver started at http://127.23.131.66:35709/ using document root <none> and password file <none>
I20260809 22:53:08.635629 12827 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:08.635814 12827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 22:53:08 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315988, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:08.664821 12827 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.004s sys 0.000s
I20260809 22:53:08.679908 12872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:08.687700 12827 fs_manager.cc:725] Time spent opening block manager: real 0.021s user 0.003s sys 0.013s
I20260809 22:53:08.688033 12827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "f4b352d244814834a6f7d8bba46a6d48"
format_stamp: "Formatted at 2026-08-09 22:53:05 on dist-test-slave-92m1"
server_key: "0f2cb385d9dd269d1b3089ef1fd82f9f"
server_key_iv: "7139f5b37a2ddb754eaac11095f4f5eb"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:08.689709 12827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:08.710071 12827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:08.715690 12827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:08.716102 12827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:08.726779 12827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:08.728909 12827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:08.729028 12827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:08.729146 12827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:08.729244 12827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:08.778941 12827 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:33333
I20260809 22:53:08.779119 13049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:33333 every 8 connection(s)
I20260809 22:53:08.780880 12827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:53:08.787955 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 12827
I20260809 22:53:08.788782 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.131.84:58557/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:38889
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:40423
--webserver_port=37505
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:53:08 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786315988, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 22:53:08 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315988, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:08.816900 13054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:08.784585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40423 (local address 127.23.131.66:40913)
0809 22:53:08.786991 (+ 2406us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:08.787044 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:08.789542 (+ 2498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:08.796461 (+ 6919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:08.796476 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:08.797165 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:08.797971 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:08.797997 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.799626 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.799632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:08.801805 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:08.801824 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.803181 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.803188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:08.803513 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:08.804395 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:08.804428 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:08.807297 (+ 2869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:08.811658 (+ 4361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:08.811668 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:08.811691 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:08.812400 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:08.812902 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:08.812907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:08.812911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:08.813191 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:08.813982 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:08.813991 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:08.814490 (+ 499us) client_negotiation.cc:769] Sending connection context
0809 22:53:08.814817 (+ 327us) client_negotiation.cc:240] Negotiation successful
0809 22:53:08.815440 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2085,"thread_start_us":1858,"threads_started":1}
I20260809 22:53:08.817994 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:08.785328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:40913 (local address 127.23.131.126:40423)
0809 22:53:08.795676 (+ 10348us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:08.795686 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:08.795717 (+ 31us) server_negotiation.cc:407] Connection header received
0809 22:53:08.795807 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:08.795815 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:08.795940 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:08.796085 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:08.798163 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.799428 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.802011 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:08.802669 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:08.802770 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:08.807607 (+ 4837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:08.807614 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:08.807620 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:08.807663 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:08.811466 (+ 3803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:08.812569 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:08.812575 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:08.812578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:08.812754 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:08.813334 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:08.813339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:08.813342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:08.813733 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:08.813880 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:08.817382 (+ 3502us) server_negotiation.cc:299] Negotiation successful
0809 22:53:08.817623 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10158,"thread_start_us":9982,"threads_started":1}
I20260809 22:53:08.820935 13050 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40423
I20260809 22:53:08.821257 13050 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:08.822153 13050 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:08.824318 12512 ts_manager.cc:194] Registered new tserver with Master: f4b352d244814834a6f7d8bba46a6d48 (127.23.131.66:33333)
I20260809 22:53:08.826514 12512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:40913
I20260809 22:53:09.226492 12822 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:09.226980 12822 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:09.228919 12512 ts_manager.cc:194] Registered new tserver with Master: 551a30243fe848af8bc6acba94a1889d (127.23.131.65:41365)
I20260809 22:53:09.231154 12512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:59389
W20260809 22:53:09.250085 13057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:09.250501 13057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:09.250713 13057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:09.262567 13057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:09.262781 13057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:09.263010 13057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:53:09.278252 13057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.131.84:58557/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:38889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=37505
--tserver_master_addrs=127.23.131.126:40423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:09.280280 13057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:09.282219 13057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 09 22:53:09 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315988, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
W20260809 22:53:09.309760 13066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:09.311234 13067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:09.317559 13069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:09.320369 13057 server_base.cc:1034] running on GCE node
I20260809 22:53:09.321205 13057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:09.339496 13057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:09.343153 13057 hybrid_clock.cc:648] HybridClock initialized: now 1786315989343059 us; error 93 us; skew 500 ppm
I20260809 22:53:09.343614 13057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:09 dist-test-slave-92m1 krb5kdc[10909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315989, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:09.348747 13057 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:53:09.368257 13057 webserver.cc:460] Webserver started at http://127.23.131.67:37505/ using document root <none> and password file <none>
I20260809 22:53:09.369470 13057 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:09.369732 13057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 22:53:09 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315989, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:09.432407 13057 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 22:53:09.435881 13079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:09.437534 13057 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260809 22:53:09.437757 13057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509"
format_stamp: "Formatted at 2026-08-09 22:53:06 on dist-test-slave-92m1"
server_key: "3fdad620e77e80ceab036b31034e032c"
server_key_iv: "dc5f79dd74df45f200c01c74dd0581c7"
server_key_version: "kuduclusterkey@0"
I20260809 22:53:09.438937 13057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:09.460719 13057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:09.465000 13057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:09.465330 13057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:09.466491 13057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:09.469132 13057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:09.469244 13057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:09.469342 13057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:09.469424 13057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:09.564406 13057 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:38889
I20260809 22:53:09.564467 13250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:38889 every 8 connection(s)
I20260809 22:53:09.565975 13057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:53:09.568890 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 13057
Aug 09 22:53:09 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315989, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:09.600390 13256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.570774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33060 (local address 127.23.131.126:40423)
0809 22:53:09.572145 (+ 1371us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.572154 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.572178 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:53:09.572250 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.572256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.572353 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.572467 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:09.582287 (+ 9820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.583616 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.585992 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.587011 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.587171 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.591102 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:09.591112 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:09.591116 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:09.591158 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:09.595818 (+ 4660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:09.597090 (+ 1272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:09.597098 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:09.597103 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:09.597260 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:09.598498 (+ 1238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:09.598503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:09.598508 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:09.598996 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:09.599287 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.599662 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.599885 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":217,"server-negotiator.queue_time_us":1249,"thread_start_us":1120,"threads_started":1}
I20260809 22:53:09.602052 13258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.574639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:37103 (local address 127.23.131.126:40423)
0809 22:53:09.580181 (+ 5542us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.580189 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.580210 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:53:09.580273 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.580277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.580362 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.580471 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:09.582228 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.583616 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.585961 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.587011 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.587413 (+ 402us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.592666 (+ 5253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:09.592674 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:09.592678 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:09.592733 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:09.597466 (+ 4733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:09.598454 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:09.598460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:09.598467 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:09.598612 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:09.599855 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:09.599861 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:09.599863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:09.600270 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:09.600405 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.601460 (+ 1055us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.601682 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":430,"server-negotiator.queue_time_us":5388,"thread_start_us":5229,"threads_started":1}
I20260809 22:53:09.604612 13257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.573622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40423 (local address 127.23.131.67:37103)
0809 22:53:09.575447 (+ 1825us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.575500 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.578618 (+ 3118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.580938 (+ 2320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.580953 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.581466 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:09.582037 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.582053 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.583833 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.583838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.585820 (+ 1982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.585832 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.587925 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.587935 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.588268 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.588997 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:09.589034 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:09.592378 (+ 3344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:09.597681 (+ 5303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:09.597693 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:09.597712 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:09.598330 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:09.598750 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:09.598757 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:09.598760 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:09.599016 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:09.600764 (+ 1748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:09.600770 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:09.601102 (+ 332us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.601382 (+ 280us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.601934 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1522,"thread_start_us":1312,"threads_started":1}
I20260809 22:53:09.606283 13251 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40423
I20260809 22:53:09.606603 13251 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:09.607398 13251 heartbeater.cc:511] Master 127.23.131.126:40423 requested a full tablet report, sending...
I20260809 22:53:09.610824 12512 ts_manager.cc:194] Registered new tserver with Master: 2ce269ab9f8c460b9cd2e9e77d2ce509 (127.23.131.67:38889)
I20260809 22:53:09.611869 12512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:37103
I20260809 22:53:09.617903 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:53:09.660066 13258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.636090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.23.131.126:40423)
0809 22:53:09.637154 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.637161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.643154 (+ 5993us) server_negotiation.cc:407] Connection header received
0809 22:53:09.643389 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.643394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.643500 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.643619 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:09.645951 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.646991 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.648859 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.649463 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.649569 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.653222 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:09.653228 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:09.653233 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:09.653272 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:09.656775 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:09.657659 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:09.657665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:09.657668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:09.657820 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:09.658304 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:09.658309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:09.658311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:09.658642 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:09.658885 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.659480 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.659722 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 22:53:09 dist-test-slave-92m1 krb5kdc[10909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315988, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for HTTP/127.23.131.84@KRBTEST.COM
I20260809 22:53:09.666489 12512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:53:09.677109 12512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:53:09.741642 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.715298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:33333 (local address 127.0.0.1:49562)
0809 22:53:09.717406 (+ 2108us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.717422 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.717518 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.731556 (+ 14038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.731566 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.731599 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.732049 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.732062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.735097 (+ 3035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.735103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.737497 (+ 2394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.737514 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.740652 (+ 3138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.740659 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.740878 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.740940 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.741082 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.741280 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1987,"thread_start_us":1833,"threads_started":1}
I20260809 22:53:09.743014 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.715925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49562 (local address 127.23.131.66:33333)
0809 22:53:09.730754 (+ 14829us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.730765 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.730800 (+ 35us) server_negotiation.cc:407] Connection header received
0809 22:53:09.730911 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.730920 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.731284 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.731535 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.732242 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.734918 (+ 2676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.738819 (+ 3901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.740399 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.742193 (+ 1794us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.742432 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.742509 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.742690 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14626,"thread_start_us":15814,"threads_started":1}
I20260809 22:53:09.747434 12952 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3921f319ae417388127402293a8d2d (DEFAULT_TABLE table=test-table [id=fccda98e458342289d40b259c188b5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:09.748984 12952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3921f319ae417388127402293a8d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:09.770041 13274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.706140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48762)
0809 22:53:09.716778 (+ 10638us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.716798 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.716919 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.758699 (+ 41780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.758704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.758734 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.759135 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.759153 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.764897 (+ 5744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.764904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.767093 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.767113 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.769181 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.769188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.769371 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.769430 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.769508 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.769649 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10497,"thread_start_us":11759,"threads_started":1}
I20260809 22:53:09.771245 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.706438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48762 (local address 127.23.131.65:41365)
0809 22:53:09.758089 (+ 51651us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.758099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.758130 (+ 31us) server_negotiation.cc:407] Connection header received
0809 22:53:09.758237 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.758243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.758460 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.759455 (+ 995us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.759691 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.761213 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.767367 (+ 6154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.768921 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.770326 (+ 1405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.770584 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.770663 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.770862 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51450,"thread_start_us":51271,"threads_started":1}
I20260809 22:53:09.775382 13282 tablet_bootstrap.cc:492] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Bootstrap starting.
I20260809 22:53:09.775620 12722 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3921f319ae417388127402293a8d2d (DEFAULT_TABLE table=test-table [id=fccda98e458342289d40b259c188b5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:09.777221 12722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3921f319ae417388127402293a8d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:09.778954 13277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.704396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:38889 (local address 127.0.0.1:49926)
0809 22:53:09.715862 (+ 11466us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.715905 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.716113 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.755763 (+ 39650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.755769 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.755805 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.756201 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.756216 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.773895 (+ 17679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.773904 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.776090 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.776107 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.778169 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.778175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.778339 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.778372 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.778445 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.778595 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11164,"thread_start_us":15436,"threads_started":1}
I20260809 22:53:09.780069 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.705665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49926 (local address 127.23.131.67:38889)
0809 22:53:09.754901 (+ 49236us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.754927 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.754978 (+ 51us) server_negotiation.cc:407] Connection header received
0809 22:53:09.755125 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.755137 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.755492 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.755765 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.771398 (+ 15633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.773645 (+ 2247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.776331 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.777870 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.779202 (+ 1332us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.779483 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.779573 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.779738 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48953,"thread_start_us":50453,"threads_started":1}
I20260809 22:53:09.784480 13154 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3921f319ae417388127402293a8d2d (DEFAULT_TABLE table=test-table [id=fccda98e458342289d40b259c188b5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:09.785940 13154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3921f319ae417388127402293a8d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:09.810150 13282 tablet_bootstrap.cc:654] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:09.811616 13282 log.cc:824] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:09.822890 13282 tablet_bootstrap.cc:492] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: No bootstrap required, opened a new log
I20260809 22:53:09.823272 13282 ts_tablet_manager.cc:1397] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.000s
I20260809 22:53:09.831439 13050 heartbeater.cc:503] Master 127.23.131.126:40423 was elected leader, sending a full tablet report...
I20260809 22:53:09.837105 13285 tablet_bootstrap.cc:492] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Bootstrap starting.
I20260809 22:53:09.842213 13285 tablet_bootstrap.cc:654] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:09.843766 13285 log.cc:824] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:09.844113 13288 tablet_bootstrap.cc:492] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Bootstrap starting.
I20260809 22:53:09.850646 13282 raft_consensus.cc:348] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.851192 13282 raft_consensus.cc:374] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:09.851327 13282 raft_consensus.cc:729] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4b352d244814834a6f7d8bba46a6d48, State: Initialized, Role: FOLLOWER
I20260809 22:53:09.852046 13282 consensus_queue.cc:260] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.853464 13288 tablet_bootstrap.cc:654] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:09.854873 13288 log.cc:824] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:09.854990 13285 tablet_bootstrap.cc:492] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: No bootstrap required, opened a new log
I20260809 22:53:09.855360 13285 ts_tablet_manager.cc:1397] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.009s
I20260809 22:53:09.860862 13282 ts_tablet_manager.cc:1428] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Time spent starting tablet: real 0.037s user 0.013s sys 0.002s
I20260809 22:53:09.869565 13285 raft_consensus.cc:348] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.870038 13285 raft_consensus.cc:374] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:09.870146 13285 raft_consensus.cc:729] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 551a30243fe848af8bc6acba94a1889d, State: Initialized, Role: FOLLOWER
I20260809 22:53:09.873616 13288 tablet_bootstrap.cc:492] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: No bootstrap required, opened a new log
I20260809 22:53:09.873420 13285 consensus_queue.cc:260] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.873930 13288 ts_tablet_manager.cc:1397] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Time spent bootstrapping tablet: real 0.030s user 0.015s sys 0.004s
I20260809 22:53:09.886034 13288 raft_consensus.cc:348] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.886530 13288 raft_consensus.cc:374] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:09.886649 13288 raft_consensus.cc:729] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce269ab9f8c460b9cd2e9e77d2ce509, State: Initialized, Role: FOLLOWER
I20260809 22:53:09.887432 13288 consensus_queue.cc:260] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.888067 12822 heartbeater.cc:503] Master 127.23.131.126:40423 was elected leader, sending a full tablet report...
I20260809 22:53:09.888836 13285 ts_tablet_manager.cc:1428] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Time spent starting tablet: real 0.033s user 0.014s sys 0.012s
I20260809 22:53:09.890290 13251 heartbeater.cc:503] Master 127.23.131.126:40423 was elected leader, sending a full tablet report...
I20260809 22:53:09.891255 13288 ts_tablet_manager.cc:1428] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260809 22:53:09.922374 13293 raft_consensus.cc:482] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:09.922744 13293 raft_consensus.cc:504] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.925128 13293 leader_election.cc:288] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce269ab9f8c460b9cd2e9e77d2ce509 (127.23.131.67:38889), f4b352d244814834a6f7d8bba46a6d48 (127.23.131.66:33333)
I20260809 22:53:09.931901 13294 raft_consensus.cc:482] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:09.932245 13294 raft_consensus.cc:504] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.934366 13294 leader_election.cc:288] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 551a30243fe848af8bc6acba94a1889d (127.23.131.65:41365), f4b352d244814834a6f7d8bba46a6d48 (127.23.131.66:33333)
W20260809 22:53:09.943655 12823 tablet.cc:2369] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:09.945402 13257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.934885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.23.131.67:55963)
0809 22:53:09.935993 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.936010 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.936130 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.937788 (+ 1658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.937792 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.937817 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.938105 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.938116 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.939517 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.939522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.941448 (+ 1926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.941463 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.944504 (+ 3041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.944518 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.944796 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.944830 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.944918 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.945049 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":983,"mutex_wait_us":58,"spinlock_wait_cycles":1792}
I20260809 22:53:09.947415 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.937203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:55963 (local address 127.23.131.65:41365)
0809 22:53:09.937368 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.937374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.937392 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:53:09.937466 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.937471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.937537 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.937620 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.938277 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.939340 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.941656 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.942984 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.943161 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.946940 (+ 3779us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.946993 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.947153 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2227,"server-negotiator.queue_time_us":45}
I20260809 22:53:09.948297 12754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3921f319ae417388127402293a8d2d" candidate_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "551a30243fe848af8bc6acba94a1889d" is_pre_election: true
I20260809 22:53:09.948796 12754 raft_consensus.cc:2454] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce269ab9f8c460b9cd2e9e77d2ce509 in term 0.
I20260809 22:53:09.948995 13298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.935413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:33333 (local address 127.23.131.67:41541)
0809 22:53:09.936067 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.936092 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.936211 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.937808 (+ 1597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.937814 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.937840 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.938841 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.938856 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.942172 (+ 3316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.942177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.946004 (+ 3827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.946019 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.948110 (+ 2091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.948116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.948285 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.948319 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.948412 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.948589 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":161,"thread_start_us":1328,"threads_started":1}
I20260809 22:53:09.949484 13084 leader_election.cc:302] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce269ab9f8c460b9cd2e9e77d2ce509, 551a30243fe848af8bc6acba94a1889d; no voters:
I20260809 22:53:09.949937 13294 raft_consensus.cc:2781] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:53:09.949967 13299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.936569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:41541 (local address 127.23.131.66:33333)
0809 22:53:09.937232 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.937238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.937263 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:53:09.937338 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.937343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.937421 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.937524 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.939721 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.941166 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.946187 (+ 5021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.947482 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.947893 (+ 411us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.947973 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.949415 (+ 1442us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.949578 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":394,"threads_started":1}
I20260809 22:53:09.950078 13294 raft_consensus.cc:482] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:53:09.950168 13294 raft_consensus.cc:3037] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:09.951004 12979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3921f319ae417388127402293a8d2d" candidate_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4b352d244814834a6f7d8bba46a6d48" is_pre_election: true
I20260809 22:53:09.951622 12979 raft_consensus.cc:2454] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce269ab9f8c460b9cd2e9e77d2ce509 in term 0.
I20260809 22:53:09.953462 13294 raft_consensus.cc:504] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.954664 12754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3921f319ae417388127402293a8d2d" candidate_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "551a30243fe848af8bc6acba94a1889d"
I20260809 22:53:09.954882 12754 raft_consensus.cc:3037] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:09.958324 12754 raft_consensus.cc:2454] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce269ab9f8c460b9cd2e9e77d2ce509 in term 1.
I20260809 22:53:09.958858 13084 leader_election.cc:302] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce269ab9f8c460b9cd2e9e77d2ce509, 551a30243fe848af8bc6acba94a1889d; no voters:
I20260809 22:53:09.962951 12979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3921f319ae417388127402293a8d2d" candidate_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4b352d244814834a6f7d8bba46a6d48"
I20260809 22:53:09.963249 12979 raft_consensus.cc:3037] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:09.966480 12979 raft_consensus.cc:2454] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce269ab9f8c460b9cd2e9e77d2ce509 in term 1.
I20260809 22:53:09.967221 13294 leader_election.cc:288] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [CANDIDATE]: Term 1 election: Requested vote from peers 551a30243fe848af8bc6acba94a1889d (127.23.131.65:41365), f4b352d244814834a6f7d8bba46a6d48 (127.23.131.66:33333)
I20260809 22:53:09.967504 13294 raft_consensus.cc:2781] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:09.967685 13294 raft_consensus.cc:686] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 1 LEADER]: Becoming Leader. State: Replica: 2ce269ab9f8c460b9cd2e9e77d2ce509, State: Running, Role: LEADER
I20260809 22:53:09.968312 13294 consensus_queue.cc:237] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } }
I20260809 22:53:09.976277 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.926261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:54043 (local address 127.23.131.67:38889)
0809 22:53:09.926451 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.926459 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.935628 (+ 9169us) server_negotiation.cc:407] Connection header received
0809 22:53:09.939240 (+ 3612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.939246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.939321 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.939385 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.940932 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.942050 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.973458 (+ 31408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.974825 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.975003 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.975110 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.975825 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.975975 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":36}
I20260809 22:53:09.977216 13297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.925456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:38889 (local address 127.23.131.65:54043)
0809 22:53:09.935504 (+ 10048us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.935526 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.938615 (+ 3089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.939621 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.939627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.939661 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.940095 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.940108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.943387 (+ 3279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.943394 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.946720 (+ 3326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.946754 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.975396 (+ 28642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.975404 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.975599 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.975637 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.976596 (+ 959us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.976764 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9909,"mutex_wait_us":1267,"thread_start_us":17593,"threads_started":1}
I20260809 22:53:09.978271 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3921f319ae417388127402293a8d2d" candidate_uuid: "551a30243fe848af8bc6acba94a1889d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" is_pre_election: true
I20260809 22:53:09.982748 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.926682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:51337 (local address 127.23.131.66:33333)
0809 22:53:09.926935 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:09.926943 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:09.941765 (+ 14822us) server_negotiation.cc:407] Connection header received
0809 22:53:09.942003 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:09.942007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:09.942101 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:09.942164 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:09.943090 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.944265 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.980016 (+ 35751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.981342 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.981504 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.981574 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:09.982330 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 22:53:09.982484 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:53:09.983846 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:09.925886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:33333 (local address 127.23.131.65:51337)
0809 22:53:09.941670 (+ 15784us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:09.941689 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:09.941865 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:09.942366 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:09.942372 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:09.942398 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:09.942863 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.942882 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.944571 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.944576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.973141 (+ 28565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:09.973173 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:09.981901 (+ 8728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:09.981908 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:09.982111 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:09.982146 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 22:53:09.983283 (+ 1137us) client_negotiation.cc:240] Negotiation successful
0809 22:53:09.983467 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15647,"mutex_wait_us":2292,"thread_start_us":9238,"threads_started":1}
I20260809 22:53:09.984686 12979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3921f319ae417388127402293a8d2d" candidate_uuid: "551a30243fe848af8bc6acba94a1889d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4b352d244814834a6f7d8bba46a6d48" is_pre_election: true
I20260809 22:53:09.985052 12979 raft_consensus.cc:2379] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 551a30243fe848af8bc6acba94a1889d in current term 1: Already voted for candidate 2ce269ab9f8c460b9cd2e9e77d2ce509 in this term.
I20260809 22:53:09.986052 12657 leader_election.cc:302] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 551a30243fe848af8bc6acba94a1889d; no voters: 2ce269ab9f8c460b9cd2e9e77d2ce509, f4b352d244814834a6f7d8bba46a6d48
I20260809 22:53:09.986773 13293 raft_consensus.cc:2726] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 22:53:09.988569 12511 catalog_manager.cc:5495] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce269ab9f8c460b9cd2e9e77d2ce509 (127.23.131.67). New cstate: current_term: 1 leader_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce269ab9f8c460b9cd2e9e77d2ce509" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 38889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 } health_report { overall_health: UNKNOWN } } }
W20260809 22:53:10.047910 13052 tablet.cc:2369] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:10.050081 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.042000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.23.131.67:38889)
0809 22:53:10.042199 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:10.042207 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:10.042230 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:53:10.042361 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:10.042367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:10.042497 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:10.042697 (+ 200us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:53:10.043715 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.044909 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.047102 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.047718 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.047857 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:10.048715 (+ 858us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:53:10.049332 (+ 617us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:53:10.049513 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:10.049635 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 22:53:10.049731 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:53:10.059885 12754 raft_consensus.cc:1261] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 1 FOLLOWER]: Refusing update from remote peer 2ce269ab9f8c460b9cd2e9e77d2ce509: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:10.060195 12979 raft_consensus.cc:1261] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 1 FOLLOWER]: Refusing update from remote peer 2ce269ab9f8c460b9cd2e9e77d2ce509: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:10.061144 13294 consensus_queue.cc:1035] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4b352d244814834a6f7d8bba46a6d48" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:10.061676 13300 consensus_queue.cc:1035] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [LEADER]: Connected to new peer: Peer: permanent_uuid: "551a30243fe848af8bc6acba94a1889d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 41365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:10.075791 13314 mvcc.cc:205] Tried to move back new op lower bound from 7316750295270715392 to 7316750294915772416. Current Snapshot: MvccSnapshot[applied={T|T < 7316750295270715392}]
I20260809 22:53:10.095162 12512 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:10.095564 12512 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:10.099957 12512 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3b7ae44c4574ff78bfde9a920c6c731: Sending DeleteTablet for 3 replicas of tablet 6f3921f319ae417388127402293a8d2d
I20260809 22:53:10.101245 13154 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3921f319ae417388127402293a8d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:10 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:49926
I20260809 22:53:10.101666 12952 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3921f319ae417388127402293a8d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:10 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:49562
I20260809 22:53:10.102852 12722 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3921f319ae417388127402293a8d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:10 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:48762
I20260809 22:53:10.107764 13339 tablet_replica.cc:330] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: stopping tablet replica
I20260809 22:53:10.108202 13339 raft_consensus.cc:2229] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:10.108685 13339 raft_consensus.cc:2258] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:10.110059 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 12573
I20260809 22:53:10.115402 13339 ts_tablet_manager.cc:1905] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:10.122961 13339 ts_tablet_manager.cc:1918] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:10.123318 13339 log.cc:1196] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/6f3921f319ae417388127402293a8d2d
I20260809 22:53:10.124028 13339 ts_tablet_manager.cc:1939] T 6f3921f319ae417388127402293a8d2d P f4b352d244814834a6f7d8bba46a6d48: Deleting consensus metadata
I20260809 22:53:10.124639 13343 tablet_replica.cc:330] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: stopping tablet replica
I20260809 22:53:10.125190 13343 raft_consensus.cc:2229] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:10.125844 13343 raft_consensus.cc:2258] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:10.126484 12488 catalog_manager.cc:4841] TS f4b352d244814834a6f7d8bba46a6d48 (127.23.131.66:33333): tablet 6f3921f319ae417388127402293a8d2d (table test-table [id=fccda98e458342289d40b259c188b5f9]) successfully deleted
I20260809 22:53:10.130363 13343 ts_tablet_manager.cc:1905] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:10.142488 13338 tablet_replica.cc:330] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: stopping tablet replica
I20260809 22:53:10.142969 13338 raft_consensus.cc:2229] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:53:10.143826 13338 raft_consensus.cc:2258] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:10.146361 13338 ts_tablet_manager.cc:1905] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:10.154394 13338 ts_tablet_manager.cc:1918] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:10.154590 13338 log.cc:1196] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/6f3921f319ae417388127402293a8d2d
I20260809 22:53:10.155169 13338 ts_tablet_manager.cc:1939] T 6f3921f319ae417388127402293a8d2d P 2ce269ab9f8c460b9cd2e9e77d2ce509: Deleting consensus metadata
I20260809 22:53:10.157312 12485 catalog_manager.cc:4841] TS 2ce269ab9f8c460b9cd2e9e77d2ce509 (127.23.131.67:38889): tablet 6f3921f319ae417388127402293a8d2d (table test-table [id=fccda98e458342289d40b259c188b5f9]) successfully deleted
I20260809 22:53:10.158155 13343 ts_tablet_manager.cc:1918] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:10.158340 13343 log.cc:1196] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/6f3921f319ae417388127402293a8d2d
I20260809 22:53:10.159107 13343 ts_tablet_manager.cc:1939] T 6f3921f319ae417388127402293a8d2d P 551a30243fe848af8bc6acba94a1889d: Deleting consensus metadata
I20260809 22:53:10.159113 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.112471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48774 (local address 127.23.131.65:41365)
0809 22:53:10.112768 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:10.112778 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:10.120070 (+ 7292us) server_negotiation.cc:407] Connection header received
0809 22:53:10.120298 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:10.120307 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:10.120438 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:10.120547 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:10.123360 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.124785 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.129185 (+ 4400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.129811 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.129946 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:10.147323 (+ 17377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:10.147341 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:10.147359 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:10.147423 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:10.151669 (+ 4246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:10.152714 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:10.152723 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:10.152728 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:10.152880 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:10.155763 (+ 2883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:10.155769 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:10.155772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:10.156282 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:10.156763 (+ 481us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:10.158190 (+ 1427us) server_negotiation.cc:299] Negotiation successful
0809 22:53:10.158653 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 22:53:10.159914 12817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:10.257419 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 12573
W20260809 22:53:10.290735 12486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:41365 (error 108)
I20260809 22:53:10.291842 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 12827
I20260809 22:53:10.316141 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.306808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48782)
0809 22:53:10.315693 (+ 8885us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.315871 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8700,"thread_start_us":8553,"threads_started":1}
W20260809 22:53:10.316546 12486 catalog_manager.cc:4584] TS 551a30243fe848af8bc6acba94a1889d (127.23.131.65:41365): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6f3921f319ae417388127402293a8d2d: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
I20260809 22:53:10.318816 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.294017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.23.131.66:33333)
0809 22:53:10.294279 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:10.294289 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:10.294314 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:53:10.294401 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:10.294410 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:10.294527 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:10.294683 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:10.297588 (+ 2905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.299126 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.302300 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.303307 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.303479 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:10.308222 (+ 4743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:10.308249 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:10.308275 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:10.308339 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:10.313913 (+ 5574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:10.315286 (+ 1373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:10.315299 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:10.315304 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:10.315499 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:10.316097 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:10.316103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:10.316107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:10.316625 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:10.318039 (+ 1414us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:10.318208 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 22:53:10.318463 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 22:53:10.319610 13041 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:10.370323 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.369703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48792)
0809 22:53:10.370047 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.370164 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198}
I20260809 22:53:10.371587 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.371092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48798)
0809 22:53:10.371336 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.371418 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 22:53:10.432559 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.431910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48810)
0809 22:53:10.432233 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.432350 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260809 22:53:10.433897 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.433423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48816)
0809 22:53:10.433632 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.433718 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 22:53:10.483865 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 12827
I20260809 22:53:10.514940 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.514259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48824)
0809 22:53:10.514613 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.514728 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207}
I20260809 22:53:10.516520 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.515946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48834)
0809 22:53:10.516230 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.516331 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
I20260809 22:53:10.518918 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 13057
I20260809 22:53:10.537976 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.519761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.23.131.67:38889)
0809 22:53:10.519957 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:10.519963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:10.519987 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:53:10.520207 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:10.520213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:10.520314 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:10.520438 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:10.522217 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.523593 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.525487 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:10.526259 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:10.526424 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:10.529827 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:10.529846 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:10.529868 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:10.529912 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:10.534510 (+ 4598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:10.535433 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:10.535443 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:10.535446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:10.535605 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:10.536058 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:10.536064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:10.536069 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:10.536655 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:10.537004 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:10.537315 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 22:53:10.537594 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 22:53:10.538831 13244 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:10.671979 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 13057
I20260809 22:53:10.689378 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.688898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48848)
0809 22:53:10.689123 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.689231 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 22:53:10.690619 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:10.690244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:41365 (local address 127.0.0.1:48864)
0809 22:53:10.690404 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:10.690476 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 22:53:10.706852 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 12456
I20260809 22:53:10.708254 12562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:10.829105 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 12456
I20260809 22:53:10.869875 24077 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 22:53:11.216077 24077 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 22:53:11.216324 24077 mini_ranger.cc:66] Stopping Ranger...
I20260809 22:53:11.573611 24077 mini_ranger.cc:68] Stopped Ranger
2026-08-09 22:53:11.573 UTC [10959] LOG: received smart shutdown request
2026-08-09 22:53:11.577 UTC [10959] LOG: background worker "logical replication launcher" (PID 10972) exited with exit code 1
2026-08-09 22:53:11.577 UTC [10964] LOG: shutting down
2026-08-09 22:53:11.754 UTC [10959] LOG: database system is shut down
2026-08-09T22:53:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55738 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:53:12 dist-test-slave-92m1 krb5kdc[13365](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:53:12 dist-test-slave-92m1 krb5kdc[13365](info): set up 2 sockets
Aug 09 22:53:12 dist-test-slave-92m1 krb5kdc[13365](info): commencing operation
krb5kdc: starting...
W20260809 22:53:13.265455 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:53:13 dist-test-slave-92m1 krb5kdc[13365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:53:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:53:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:53:13.619647 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:36223
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:36223,127.23.131.125:46531,127.23.131.124:33887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:13.986681 13381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:13.987035 13381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:13.987133 13381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:13.994855 13381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:13.994974 13381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:13.995023 13381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:13.995083 13381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:13.995129 13381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:14.005425 13381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:36223,127.23.131.125:46531,127.23.131.124:33887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:36223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:14.006783 13381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:14.008134 13381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:14.020782 13390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:14.020955 13386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:14.020798 13388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:14.021802 13381 server_base.cc:1034] running on GCE node
I20260809 22:53:14.022701 13381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:14.024286 13381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:14.025554 13381 hybrid_clock.cc:648] HybridClock initialized: now 1786315994025510 us; error 38 us; skew 500 ppm
I20260809 22:53:14.025944 13381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:14 dist-test-slave-92m1 krb5kdc[13365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:14.036381 13381 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:14.038132 13381 webserver.cc:460] Webserver started at http://127.23.131.126:44663/ using document root <none> and password file <none>
I20260809 22:53:14.038846 13381 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:14.038952 13381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:14.039278 13381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:14.042488 13381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "eacdbd717cc042ae99c1654dbaf81dd2"
format_stamp: "Formatted at 2026-08-09 22:53:14 on dist-test-slave-92m1"
server_key: "df1652d5bcd30ac23f06ca6e41e8c1ac"
server_key_iv: "9303c7d13a7746969cdd2952ff741c89"
server_key_version: "encryptionkey@0"
I20260809 22:53:14.043478 13381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "eacdbd717cc042ae99c1654dbaf81dd2"
format_stamp: "Formatted at 2026-08-09 22:53:14 on dist-test-slave-92m1"
server_key: "df1652d5bcd30ac23f06ca6e41e8c1ac"
server_key_iv: "9303c7d13a7746969cdd2952ff741c89"
server_key_version: "encryptionkey@0"
I20260809 22:53:14.049296 13381 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:53:14.053262 13402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:14.054723 13381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:53:14.054921 13381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "eacdbd717cc042ae99c1654dbaf81dd2"
format_stamp: "Formatted at 2026-08-09 22:53:14 on dist-test-slave-92m1"
server_key: "df1652d5bcd30ac23f06ca6e41e8c1ac"
server_key_iv: "9303c7d13a7746969cdd2952ff741c89"
server_key_version: "encryptionkey@0"
I20260809 22:53:14.055140 13381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:14.073999 13381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:14.079763 13381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:14.080111 13381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:14.101235 13381 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:36223
I20260809 22:53:14.101275 13470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:36223 every 8 connection(s)
I20260809 22:53:14.102723 13381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:14.106334 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 13381
I20260809 22:53:14.106621 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:53:14.107056 13471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:14.107414 24077 external_mini_cluster.cc:1428] Setting key f53c78ff96f920e8152ce0446bc2eb86
I20260809 22:53:14.113961 13471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:53:14 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.131.125@KRBTEST.COM; defaulting to no policy
I20260809 22:53:14.137893 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.117513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41706 (local address 127.23.131.126:36223)
0809 22:53:14.118381 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:14.118392 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:14.119020 (+ 628us) server_negotiation.cc:407] Connection header received
0809 22:53:14.121168 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:14.121174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:14.121405 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:14.121612 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:14.122942 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.124248 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.125648 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.126212 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.126418 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.130065 (+ 3647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:14.130074 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:14.130087 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:14.130116 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:14.133177 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.133926 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.133933 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.133935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.134094 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.134487 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.134494 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.134497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.135035 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:14.135288 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:14.135895 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 22:53:14.136337 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":665,"thread_start_us":445,"threads_started":1}
I20260809 22:53:14.137902 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.117522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36223 (local address 127.0.0.1:41706)
0809 22:53:14.118853 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.118887 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:14.120792 (+ 1905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:14.121644 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:14.121650 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:14.122381 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:14.122738 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.122755 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.124414 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.124422 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.125494 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.125506 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.126454 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.126461 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.126654 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.127363 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:14.127386 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:14.129838 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:14.133339 (+ 3501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.133350 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.133363 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.133782 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.134207 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.134217 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.134221 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.134379 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.135193 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:14.135232 (+ 39us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:14.135488 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 22:53:14.135762 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 22:53:14.136453 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1114,"mutex_wait_us":166,"thread_start_us":928,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.125@KRBTEST.COM" created.
I20260809 22:53:14.141127 13471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:53:14.142555 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.142128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:37970)
0809 22:53:14.142308 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.142430 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 22:53:14.142995 13404 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
I20260809 22:53:14.144796 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.144429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:37986)
0809 22:53:14.144596 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.144670 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:53:14.145143 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:46531: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab.
Entry for principal kudu/127.23.131.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab.
I20260809 22:53:14.183045 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:46531
--webserver_interface=127.23.131.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab
--principal=kudu/127.23.131.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:36223,127.23.131.125:46531,127.23.131.124:33887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:14.194540 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } attempt: 1
I20260809 22:53:14.195887 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.195404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:37988)
0809 22:53:14.195620 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.195748 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 22:53:14.197100 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.196689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:38002)
0809 22:53:14.196824 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.196912 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 22:53:14.197329 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:46531: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
I20260809 22:53:14.265641 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } attempt: 2
I20260809 22:53:14.267045 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.266535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42380)
0809 22:53:14.266804 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.266895 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 22:53:14.268132 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.267748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42382)
0809 22:53:14.267926 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.267998 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 22:53:14.268335 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:46531: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
I20260809 22:53:14.359594 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } attempt: 3
I20260809 22:53:14.360819 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.360351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42384)
0809 22:53:14.360570 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.360685 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 22:53:14.361827 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.361458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42390)
0809 22:53:14.361623 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.361690 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 22:53:14.362020 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:46531: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
I20260809 22:53:14.505307 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } attempt: 4
I20260809 22:53:14.506650 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.506084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42398)
0809 22:53:14.506419 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.506507 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194}
I20260809 22:53:14.507720 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.507343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42408)
0809 22:53:14.507497 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.507582 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 22:53:14.507901 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:46531: Network error: Client connection negotiation failed: client connection to 127.23.131.125:46531: connect: Connection refused (error 111)
W20260809 22:53:14.549129 13485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:14.549484 13485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:14.549660 13485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:14.557163 13485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:14.557274 13485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:14.557336 13485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:14.557395 13485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:14.557439 13485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:14.567687 13485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:36223,127.23.131.125:46531,127.23.131.124:33887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab
--principal=kudu/127.23.131.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:46531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.131.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:14.569018 13485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:14.570287 13485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:14.582472 13492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:14.582412 13497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:14.582508 13494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:14.583488 13485 server_base.cc:1034] running on GCE node
I20260809 22:53:14.584271 13485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:14.585686 13485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:14.586918 13485 hybrid_clock.cc:648] HybridClock initialized: now 1786315994586881 us; error 47 us; skew 500 ppm
I20260809 22:53:14.587342 13485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:14 dist-test-slave-92m1 krb5kdc[13365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:14.590495 13485 init.cc:377] Logged in from keytab as kudu/127.23.131.125@KRBTEST.COM (short username kudu)
I20260809 22:53:14.592123 13485 webserver.cc:460] Webserver started at http://127.23.131.125:45137/ using document root <none> and password file <none>
I20260809 22:53:14.592813 13485 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:14.592912 13485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:14.593163 13485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:14.596246 13485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data/instance:
uuid: "35adfbcf5a674c478a0d44380664877f"
format_stamp: "Formatted at 2026-08-09 22:53:14 on dist-test-slave-92m1"
server_key: "182690aff3e7649537eea6894a37fd13"
server_key_iv: "22686241efda90235c3b3f4158ccca92"
server_key_version: "encryptionkey@0"
I20260809 22:53:14.597038 13485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal/instance:
uuid: "35adfbcf5a674c478a0d44380664877f"
format_stamp: "Formatted at 2026-08-09 22:53:14 on dist-test-slave-92m1"
server_key: "182690aff3e7649537eea6894a37fd13"
server_key_iv: "22686241efda90235c3b3f4158ccca92"
server_key_version: "encryptionkey@0"
I20260809 22:53:14.602308 13485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:53:14.605760 13513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:14.607360 13485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:53:14.607595 13485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal
uuid: "35adfbcf5a674c478a0d44380664877f"
format_stamp: "Formatted at 2026-08-09 22:53:14 on dist-test-slave-92m1"
server_key: "182690aff3e7649537eea6894a37fd13"
server_key_iv: "22686241efda90235c3b3f4158ccca92"
server_key_version: "encryptionkey@0"
I20260809 22:53:14.607867 13485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:14.629165 13485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:14.633541 13485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:14.633888 13485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:14.653554 13485 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.125:46531
I20260809 22:53:14.653609 13582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.125:46531 every 8 connection(s)
I20260809 22:53:14.655014 13485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
I20260809 22:53:14.658674 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 13485
I20260809 22:53:14.658882 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-1/wal/instance
I20260809 22:53:14.659058 13585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:14.659526 24077 external_mini_cluster.cc:1428] Setting key 320cba85d9cd4ebf1dc48ca3601dd739
I20260809 22:53:14.669301 13585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:53:14 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.131.124@KRBTEST.COM; defaulting to no policy
I20260809 22:53:14.695758 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.672806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34646 (local address 127.23.131.126:36223)
0809 22:53:14.673412 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:14.673421 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:14.674519 (+ 1098us) server_negotiation.cc:407] Connection header received
0809 22:53:14.677402 (+ 2883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:14.677406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:14.677483 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:14.677602 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:14.680052 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.680798 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.683475 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.684201 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.684309 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.689217 (+ 4908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:14.689222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:14.689226 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:14.689273 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:14.692104 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.693135 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.693139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.693141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.693265 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.693790 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.693793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.693795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.694077 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:14.694205 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:14.695294 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0809 22:53:14.695475 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":296,"threads_started":1}
I20260809 22:53:14.696817 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.673451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36223 (local address 127.0.0.1:34646)
0809 22:53:14.674307 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.674366 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:14.677042 (+ 2676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:14.677906 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:14.677922 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:14.678851 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:14.679827 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.679857 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.680982 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.680990 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.683306 (+ 2316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.683325 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.684498 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.684513 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.684870 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.685662 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:14.685703 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:14.688941 (+ 3238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:14.692266 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.692276 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.692294 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.693001 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.693385 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.693392 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.693397 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.693671 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.694220 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:14.694230 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:14.694757 (+ 527us) client_negotiation.cc:769] Sending connection context
0809 22:53:14.695095 (+ 338us) client_negotiation.cc:240] Negotiation successful
0809 22:53:14.695602 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":375,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.124@KRBTEST.COM" created.
I20260809 22:53:14.698593 13585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:53:14 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:53:14.713631 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.699460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42410)
0809 22:53:14.699659 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.699678 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:14.699796 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:14.700850 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:14.700855 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:14.701291 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:14.701419 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.701427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.702775 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.702781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.703695 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.703707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.704517 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.704521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.704763 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.705355 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:14.705372 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:14.707600 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:14.710823 (+ 3223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.710831 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.710835 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.711273 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.711702 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.711707 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.711710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.711884 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.712523 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:14.712550 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:14.712747 (+ 197us) client_negotiation.cc:769] Sending connection context
0809 22:53:14.712893 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 22:53:14.713166 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":46}
I20260809 22:53:14.713685 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.699659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42410 (local address 127.23.131.125:46531)
0809 22:53:14.700459 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:14.700465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:14.700490 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:53:14.700530 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:14.700536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:14.700705 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:14.700856 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:14.701572 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.702642 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.703832 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.704372 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.704508 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.707804 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:14.707814 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:14.707827 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:14.707861 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:14.710671 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.711411 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.711420 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.711426 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.711551 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.712024 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.712033 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.712035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.712370 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:14.712625 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:14.713068 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 22:53:14.713285 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":645,"thread_start_us":489,"threads_started":1}
I20260809 22:53:14.716292 13585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:53:14.717545 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.717098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37066)
0809 22:53:14.717289 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.717391 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260809 22:53:14.717836 13514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:14.719501 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.719132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37078)
0809 22:53:14.719327 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.719399 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:53:14.719738 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab.
Entry for principal kudu/127.23.131.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab.
I20260809 22:53:14.738813 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:33887
--webserver_interface=127.23.131.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab
--principal=kudu/127.23.131.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:36223,127.23.131.125:46531,127.23.131.124:33887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:14.769047 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 1
I20260809 22:53:14.770388 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.769901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37084)
0809 22:53:14.770116 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.770226 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 22:53:14.771497 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.771093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37098)
0809 22:53:14.771296 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.771380 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 22:53:14.771724 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:14.807319 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } attempt: 5
Aug 09 22:53:14 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:53:14.822718 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.808169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42426)
0809 22:53:14.808404 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.808435 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:14.808544 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:14.808914 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:14.808917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:14.809329 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:14.809509 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.809517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.810949 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.810953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.812081 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:14.812094 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.813083 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.813088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:14.813219 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.813916 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:14.813935 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:14.816319 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:14.820328 (+ 4009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.820332 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.820335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.820721 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.821178 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:14.821181 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:14.821183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:14.821313 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:14.821955 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:14.821958 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:14.822094 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 22:53:14.822206 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 22:53:14.822446 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 22:53:14.823009 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.808317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42426 (local address 127.23.131.125:46531)
0809 22:53:14.808525 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:14.808532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:14.808560 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:53:14.808655 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:14.808661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:14.808764 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:14.808880 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:14.809705 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.810812 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.812222 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:14.812921 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:14.813056 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:14.816545 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:14.816552 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:14.816557 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:14.816613 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:14.820159 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.820862 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.820868 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.820873 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.821051 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:14.821422 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:14.821427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:14.821431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:14.821839 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:14.821995 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:14.822346 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 22:53:14.822609 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:53:14.824144 13471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:53:14.825249 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.824830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37102)
0809 22:53:14.825011 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.825108 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 22:53:14.826212 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.825873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37110)
0809 22:53:14.826017 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.826110 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 22:53:14.826509 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:14.840091 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 2
I20260809 22:53:14.841970 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.841351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37112)
0809 22:53:14.841654 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.841764 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260809 22:53:14.843343 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.842857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37120)
0809 22:53:14.843044 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.843125 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 22:53:14.843672 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:14.877799 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 1
I20260809 22:53:14.879082 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.878584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37122)
0809 22:53:14.878797 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.878913 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 22:53:14.880131 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.879773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37138)
0809 22:53:14.879941 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.880008 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 22:53:14.880394 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:14.934931 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 3
I20260809 22:53:14.936184 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.935689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37154)
0809 22:53:14.935898 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.935996 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 22:53:14.937307 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.936857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37160)
0809 22:53:14.937104 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.937181 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260809 22:53:14.937534 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:14.948628 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 2
I20260809 22:53:14.949932 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.949439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37176)
0809 22:53:14.949673 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.949764 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 22:53:14.951052 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:14.950691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37192)
0809 22:53:14.950866 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:14.950937 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:53:14.951375 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:15.057601 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 3
I20260809 22:53:15.058844 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.058332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37208)
0809 22:53:15.058560 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.058651 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 22:53:15.060046 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.059668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37224)
0809 22:53:15.059878 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.059946 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260809 22:53:15.060331 13471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
I20260809 22:53:15.080837 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 4
I20260809 22:53:15.082039 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.081530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37236)
0809 22:53:15.081768 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.081867 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 22:53:15.083065 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.082718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37248)
0809 22:53:15.082872 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.082955 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:53:15.083345 13585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:33887: Network error: Client connection negotiation failed: client connection to 127.23.131.124:33887: connect: Connection refused (error 111)
W20260809 22:53:15.107566 13594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:15.107926 13594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:15.108106 13594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:15.115828 13594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:15.115970 13594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:15.116086 13594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:15.116202 13594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:15.116334 13594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:15.126430 13594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:36223,127.23.131.125:46531,127.23.131.124:33887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab
--principal=kudu/127.23.131.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:33887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.131.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:15.127883 13594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:15.129216 13594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:15.141407 13602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:15.141417 13608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:15.141495 13605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:15.142642 13594 server_base.cc:1034] running on GCE node
I20260809 22:53:15.143463 13594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:15.144838 13594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:15.146049 13594 hybrid_clock.cc:648] HybridClock initialized: now 1786315995145973 us; error 64 us; skew 500 ppm
I20260809 22:53:15.146394 13594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:15.149612 13594 init.cc:377] Logged in from keytab as kudu/127.23.131.124@KRBTEST.COM (short username kudu)
I20260809 22:53:15.151166 13594 webserver.cc:460] Webserver started at http://127.23.131.124:45915/ using document root <none> and password file <none>
I20260809 22:53:15.151904 13594 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:15.152010 13594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:15.152259 13594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:15.155323 13594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data/instance:
uuid: "6ac1585d7d944ce5a6bf15a473c6d717"
format_stamp: "Formatted at 2026-08-09 22:53:15 on dist-test-slave-92m1"
server_key: "f69c770ba8803a2735a548f768d83bf6"
server_key_iv: "30a9508660f4d307ab626bc5b5ab9d2f"
server_key_version: "encryptionkey@0"
I20260809 22:53:15.156188 13594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal/instance:
uuid: "6ac1585d7d944ce5a6bf15a473c6d717"
format_stamp: "Formatted at 2026-08-09 22:53:15 on dist-test-slave-92m1"
server_key: "f69c770ba8803a2735a548f768d83bf6"
server_key_iv: "30a9508660f4d307ab626bc5b5ab9d2f"
server_key_version: "encryptionkey@0"
I20260809 22:53:15.161542 13594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:53:15.165037 13621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:15.166405 13594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:53:15.166548 13594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal
uuid: "6ac1585d7d944ce5a6bf15a473c6d717"
format_stamp: "Formatted at 2026-08-09 22:53:15 on dist-test-slave-92m1"
server_key: "f69c770ba8803a2735a548f768d83bf6"
server_key_iv: "30a9508660f4d307ab626bc5b5ab9d2f"
server_key_version: "encryptionkey@0"
I20260809 22:53:15.166715 13594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:15.181751 13594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:15.186759 13594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:15.187085 13594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:15.205679 13594 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.124:33887
I20260809 22:53:15.205703 13711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.124:33887 every 8 connection(s)
I20260809 22:53:15.207142 13594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
I20260809 22:53:15.210981 13713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:15.214160 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 13594
I20260809 22:53:15.214366 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786315774646092-24077-0/minicluster-data/master-2/wal/instance
I20260809 22:53:15.214849 24077 external_mini_cluster.cc:1428] Setting key dcb65d2182aa100d1f8f62dd42f211dc
I20260809 22:53:15.218873 13713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:15.237102 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.222361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.23.131.126:36223)
0809 22:53:15.222916 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.222920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.223595 (+ 675us) server_negotiation.cc:407] Connection header received
0809 22:53:15.223815 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.223820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.223892 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.224004 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.225156 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.225893 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.227350 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.227754 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.227911 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.231392 (+ 3481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.231397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.231400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.231432 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.234075 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.234815 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.234819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.234822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.234943 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.235451 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.235455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.235457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.235725 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.235896 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.236449 (+ 553us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.236664 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":307,"threads_started":1}
I20260809 22:53:15.237545 13471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 4
I20260809 22:53:15.238284 13722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.222377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:36223 (local address 127.0.0.1:34652)
0809 22:53:15.223452 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.223499 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:15.223679 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:15.224066 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:15.224072 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:15.224716 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:15.224984 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.224993 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.226103 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.226107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.227158 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.227171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.227990 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.227998 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.228161 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.228811 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:15.228833 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:15.231129 (+ 2296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:15.234219 (+ 3090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.234234 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.234245 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.234675 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.235060 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.235065 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.235069 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.235315 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.235873 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:15.235881 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:15.236106 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 22:53:15.236354 (+ 248us) client_negotiation.cc:240] Negotiation successful
0809 22:53:15.236862 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":692,"threads_started":1}
I20260809 22:53:15.238622 13718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.216954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.23.131.124:33887)
0809 22:53:15.217767 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.217779 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.217818 (+ 39us) server_negotiation.cc:407] Connection header received
0809 22:53:15.219589 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.219611 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.220011 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.220362 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.222302 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.224213 (+ 1911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.225594 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.226270 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.226492 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.231093 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.231101 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.231112 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.231146 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.234139 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.234948 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.234955 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.234957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.235110 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.235529 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.235534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.235538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.236108 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.236413 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.236752 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.237045 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":612,"spinlock_wait_cycles":12544,"thread_start_us":398,"threads_started":1}
I20260809 22:53:15.240445 13713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:15.255278 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.238108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37262)
0809 22:53:15.238265 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.238288 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:15.238389 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:15.239522 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:15.239529 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:15.240008 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:15.240248 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.240269 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.242225 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.242233 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.243733 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.243752 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.244784 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.244791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.244995 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.245612 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:15.245640 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:15.248144 (+ 2504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:15.252290 (+ 4146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.252295 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.252299 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.252837 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.253246 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.253253 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.253258 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.253434 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.254156 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:15.254161 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:15.254320 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 22:53:15.254469 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 22:53:15.254787 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 22:53:15.255317 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.238205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37262 (local address 127.23.131.124:33887)
0809 22:53:15.239222 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.239228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.239254 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:53:15.239299 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.239304 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.239368 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.239486 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.240427 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.242120 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.243924 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.244614 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.244751 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.248355 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.248363 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.248367 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.248405 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.252121 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.252958 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.252964 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.252969 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.253111 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.253585 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.253591 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.253594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.253989 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.254176 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.254564 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.254781 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":828,"thread_start_us":617,"threads_started":1}
I20260809 22:53:15.257015 13722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.241350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:46531 (local address 127.0.0.1:42438)
0809 22:53:15.241489 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.241508 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:15.241619 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:15.242448 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:15.242455 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:15.242915 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:15.243053 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.243082 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.244120 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.244125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.245575 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.245593 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.246327 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.246333 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.246524 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.247087 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:15.247103 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:15.249742 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:15.253827 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.253835 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.253841 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.254413 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.254924 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.254930 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.254935 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.255150 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.255882 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:15.255888 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:15.256173 (+ 285us) client_negotiation.cc:769] Sending connection context
0809 22:53:15.256345 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 22:53:15.256635 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":4}
I20260809 22:53:15.257200 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.241778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42438 (local address 127.23.131.125:46531)
0809 22:53:15.241971 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.241976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.241996 (+ 20us) server_negotiation.cc:407] Connection header received
0809 22:53:15.242071 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.242077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.242154 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.242253 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.243258 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.243967 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.245719 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.246161 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.246297 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.250020 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.250029 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.250035 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.250083 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.253680 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.254582 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.254589 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.254593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.254773 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.255333 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.255341 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.255348 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.255734 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.255902 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.256486 (+ 584us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.256759 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:53:15.258240 13713 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:53:15.261616 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.241962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34662 (local address 127.23.131.126:36223)
0809 22:53:15.242133 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.242138 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.242379 (+ 241us) server_negotiation.cc:407] Connection header received
0809 22:53:15.242434 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.242438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.242530 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.242647 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.244333 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.245392 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.248510 (+ 3118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.248998 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.249166 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.254662 (+ 5496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.254668 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.254672 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.254711 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.258420 (+ 3709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.259398 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.259405 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.259411 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.259599 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.260119 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.260123 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.260125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.260396 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.260722 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.261046 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.261281 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 22:53:15.262787 13471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: Bootstrap starting.
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
I20260809 22:53:15.267153 13471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:15.269024 13471 log.cc:824] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:15.273013 13471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: No bootstrap required, opened a new log
I20260809 22:53:15.273463 13722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.259122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37272)
0809 22:53:15.259540 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.259558 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:15.259657 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:15.260052 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:15.260056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:15.260549 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:15.260741 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.260752 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.262154 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.262162 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.263191 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.263252 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.264380 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.264385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.264625 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.265227 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:15.265244 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:15.267270 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:15.270968 (+ 3698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.270972 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.270978 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.271454 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.271814 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.271820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.271823 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.271950 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.272490 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:15.272499 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:15.272679 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 22:53:15.272825 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 22:53:15.273170 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":3}
I20260809 22:53:15.274118 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.259547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37272 (local address 127.23.131.124:33887)
0809 22:53:15.259758 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.259763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.259781 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:53:15.259826 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.259830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.259903 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.260864 (+ 961us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.261010 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.262012 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.263604 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.264260 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.264371 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.267495 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.267503 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.267509 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.267552 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.270807 (+ 3255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.271570 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.271576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.271579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.271707 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.272066 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.272071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.272074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.272375 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.272544 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.272948 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.273907 (+ 959us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":783,"server-negotiator.queue_time_us":88}
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:53:15.278746 13713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: Bootstrap starting.
I20260809 22:53:15.281862 13713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:15.282821 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.263471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.23.131.125:46531)
0809 22:53:15.263651 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.263657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.263810 (+ 153us) server_negotiation.cc:407] Connection header received
0809 22:53:15.263954 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.263959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.264037 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.264138 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.265890 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.266965 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.268857 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.269578 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.269774 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.275668 (+ 5894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.275674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.275681 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.275728 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.279371 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.280288 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.280294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.280298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.280472 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.280948 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.280954 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.280957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.281353 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.281618 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.282187 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.282435 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 22:53:15.282995 13713 log.cc:824] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:15.284633 13471 raft_consensus.cc:348] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.285027 13471 raft_consensus.cc:374] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:15.285158 13471 raft_consensus.cc:729] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacdbd717cc042ae99c1654dbaf81dd2, State: Initialized, Role: FOLLOWER
I20260809 22:53:15.285827 13471 consensus_queue.cc:260] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.287035 13729 sys_catalog.cc:455] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.287472 13713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: No bootstrap required, opened a new log
I20260809 22:53:15.287611 13729 sys_catalog.cc:458] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.288326 13471 sys_catalog.cc:564] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:15.289230 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:53:15.300483 13713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.301247 13713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:15.301455 13713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac1585d7d944ce5a6bf15a473c6d717, State: Initialized, Role: FOLLOWER
I20260809 22:53:15.302377 13713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.309608 13754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.310989 13754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.311322 13713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:15.327852 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.299354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34674 (local address 127.23.131.126:36223)
0809 22:53:15.299790 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.299799 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.305824 (+ 6025us) server_negotiation.cc:407] Connection header received
0809 22:53:15.306394 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.306403 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.306506 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.306606 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.309530 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.310997 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.313806 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.314728 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.314849 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.319705 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.319716 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.319724 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.319786 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.324018 (+ 4232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.325030 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.325035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.325040 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.325246 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.325759 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.325766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.325772 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.326156 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.326486 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.327143 (+ 657us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.327407 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283}
W20260809 22:53:15.333593 13412 tablet.cc:2369] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:15.343895 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.298289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37288 (local address 127.23.131.124:33887)
0809 22:53:15.298491 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.298498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.324948 (+ 26450us) server_negotiation.cc:407] Connection header received
0809 22:53:15.325258 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.325267 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.325364 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.325440 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.327537 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.328665 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.330608 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.331436 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.331535 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.335921 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.335927 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.335931 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.335972 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.339977 (+ 4005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.341071 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.341081 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.341087 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.341275 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.341720 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.341725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.341728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.342163 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.342484 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.343110 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.343442 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:53:15.348515 13729 raft_consensus.cc:482] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:15.348904 13729 raft_consensus.cc:504] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.350025 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.299565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42456 (local address 127.23.131.125:46531)
0809 22:53:15.299964 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.299973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.322401 (+ 22428us) server_negotiation.cc:407] Connection header received
0809 22:53:15.322933 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.322939 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.323047 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.323131 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.331182 (+ 8051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.332367 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.336942 (+ 4575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.337664 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.337788 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.341251 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.341258 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.341262 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.341313 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.344990 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.346455 (+ 1465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.346461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.346463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.346638 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.347188 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.347196 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.347252 (+ 56us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.347741 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.348055 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.349138 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.349481 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260809 22:53:15.350613 13729 leader_election.cc:288] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35adfbcf5a674c478a0d44380664877f (127.23.131.125:46531), 6ac1585d7d944ce5a6bf15a473c6d717 (127.23.131.124:33887)
I20260809 22:53:15.352459 13668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" is_pre_election: true
I20260809 22:53:15.353222 13668 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacdbd717cc042ae99c1654dbaf81dd2 in term 0.
I20260809 22:53:15.354017 13403 leader_election.cc:302] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac1585d7d944ce5a6bf15a473c6d717, eacdbd717cc042ae99c1654dbaf81dd2; no voters:
I20260809 22:53:15.354611 13729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:53:15.354776 13729 raft_consensus.cc:482] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:53:15.354889 13729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:15.358485 13729 raft_consensus.cc:504] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.364077 13729 leader_election.cc:288] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [CANDIDATE]: Term 1 election: Requested vote from peers 35adfbcf5a674c478a0d44380664877f (127.23.131.125:46531), 6ac1585d7d944ce5a6bf15a473c6d717 (127.23.131.124:33887)
I20260809 22:53:15.364197 13668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac1585d7d944ce5a6bf15a473c6d717"
I20260809 22:53:15.364462 13668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:15.353621 13381 master_runner.cc:186] Error getting master registration for 127.23.131.125:46531: OK, instance_id { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" instance_seqno: 1786315994647934 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 22:53:15.366600 13381 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 22:53:15.368152 13668 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacdbd717cc042ae99c1654dbaf81dd2 in term 1.
I20260809 22:53:15.368691 13403 leader_election.cc:302] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac1585d7d944ce5a6bf15a473c6d717, eacdbd717cc042ae99c1654dbaf81dd2; no voters:
W20260809 22:53:15.370111 13773 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:53:15.370288 13773 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:53:15.371552 13729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:15.372308 13729 raft_consensus.cc:686] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [term 1 LEADER]: Becoming Leader. State: Replica: eacdbd717cc042ae99c1654dbaf81dd2, State: Running, Role: LEADER
I20260809 22:53:15.373287 13729 consensus_queue.cc:237] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.380266 13780 sys_catalog.cc:455] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eacdbd717cc042ae99c1654dbaf81dd2. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.380723 13780 sys_catalog.cc:458] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:15.382578 13585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } attempt: 5
I20260809 22:53:15.384558 13783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:15.391774 13783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 22:53:15.395125 13781 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:53:15.395319 13781 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 09 22:53:15 dist-test-slave-92m1 krb5kdc[13365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
I20260809 22:53:15.419174 13668 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [term 1 FOLLOWER]: Refusing update from remote peer eacdbd717cc042ae99c1654dbaf81dd2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:15.421149 13780 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:15.424787 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.383994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37294 (local address 127.23.131.124:33887)
0809 22:53:15.384178 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:15.384185 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:15.384202 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:53:15.384256 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:15.384261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:15.384336 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:15.384447 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:15.390048 (+ 5601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.391482 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.394587 (+ 3105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.395471 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.395609 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.411551 (+ 15942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:15.411560 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:15.411566 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:15.411621 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:15.418406 (+ 6785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.419945 (+ 1539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.419953 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.419986 (+ 33us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.420299 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:15.421192 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:15.421226 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:15.421230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:15.422013 (+ 783us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:15.422283 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:15.423251 (+ 968us) server_negotiation.cc:299] Negotiation successful
0809 22:53:15.423717 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 22:53:15.426308 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:15.383274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:33887 (local address 127.0.0.1:37294)
0809 22:53:15.383633 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:15.383654 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:15.383770 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:15.384672 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:15.384677 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:15.385275 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:15.385508 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.385522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.392792 (+ 7270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.392799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.394322 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:15.394349 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:15.395927 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:15.395935 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:15.396689 (+ 754us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:15.398695 (+ 2006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:15.398831 (+ 136us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:15.411126 (+ 12295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:15.418788 (+ 7662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.418795 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.418800 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.419708 (+ 908us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.420614 (+ 906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:15.420619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:15.420623 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:15.420968 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:15.422443 (+ 1475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:15.422448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:15.422750 (+ 302us) client_negotiation.cc:769] Sending connection context
0809 22:53:15.424316 (+ 1566us) client_negotiation.cc:240] Negotiation successful
0809 22:53:15.425633 (+ 1317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
I20260809 22:53:15.433285 13585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: Bootstrap starting.
W20260809 22:53:15.439386 13629 tablet.cc:2369] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:15.440819 13585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:15.443158 13585 log.cc:824] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:15.386672 13594 master_runner.cc:186] Error getting master registration for 127.23.131.125:46531: OK, instance_id { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" instance_seqno: 1786315994647934 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 22:53:15.457937 13594 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 22:53:15.466143 13754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eacdbd717cc042ae99c1654dbaf81dd2. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.466671 13754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.467736 13585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: No bootstrap required, opened a new log
I20260809 22:53:15.475308 13785 mvcc.cc:205] Tried to move back new op lower bound from 7316750317208535040 to 7316750317055307776. Current Snapshot: MvccSnapshot[applied={T|T < 7316750317208535040}]
I20260809 22:53:15.480979 13786 mvcc.cc:205] Tried to move back new op lower bound from 7316750317208535040 to 7316750317055307776. Current Snapshot: MvccSnapshot[applied={T|T < 7316750317208535040}]
I20260809 22:53:15.489068 13754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.489323 13754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.489730 13780 sys_catalog.cc:455] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.490046 13780 sys_catalog.cc:458] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:15.490782 13585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.491393 13585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:15.491624 13585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35adfbcf5a674c478a0d44380664877f, State: Initialized, Role: FOLLOWER
I20260809 22:53:15.492678 13783 catalog_manager.cc:1347] Generated new cluster ID: 49d10109c481446dafed15726f6e73da
I20260809 22:53:15.492813 13783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:15.507584 13585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } }
I20260809 22:53:15.517993 13585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:15.518461 13547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:15.514810 13793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.519819 13793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.522504 13547 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 1 FOLLOWER]: Refusing update from remote peer eacdbd717cc042ae99c1654dbaf81dd2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:15.523653 13549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35adfbcf5a674c478a0d44380664877f" is_pre_election: true
I20260809 22:53:15.524197 13549 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacdbd717cc042ae99c1654dbaf81dd2 in term 1.
I20260809 22:53:15.525174 13729 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:15.526305 13548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35adfbcf5a674c478a0d44380664877f"
I20260809 22:53:15.534729 13548 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacdbd717cc042ae99c1654dbaf81dd2 in term 1.
I20260809 22:53:15.542274 13783 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:53:15.544657 13783 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:15.562299 13783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2: Generated new TSK 0
I20260809 22:53:15.563417 13783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:53:15.620537 13809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.620990 13809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.621435 13793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eacdbd717cc042ae99c1654dbaf81dd2. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.621750 13793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:53:15.623647 13780 sys_catalog.cc:455] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacdbd717cc042ae99c1654dbaf81dd2" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 36223 } } peers { permanent_uuid: "35adfbcf5a674c478a0d44380664877f" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 46531 } } peers { permanent_uuid: "6ac1585d7d944ce5a6bf15a473c6d717" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 33887 } } }
I20260809 22:53:15.623973 13780 sys_catalog.cc:458] T 00000000000000000000000000000000 P eacdbd717cc042ae99c1654dbaf81dd2 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:15.657856 13826 catalog_manager.cc:1259] Loaded cluster ID: 49d10109c481446dafed15726f6e73da
I20260809 22:53:15.657994 13826 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: loading cluster ID for follower catalog manager: success
I20260809 22:53:15.666360 13826 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: acquiring CA information for follower catalog manager: success
I20260809 22:53:15.669329 13826 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 35adfbcf5a674c478a0d44380664877f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 22:53:16.397591 13781 catalog_manager.cc:1259] Loaded cluster ID: 49d10109c481446dafed15726f6e73da
I20260809 22:53:16.397697 13781 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: loading cluster ID for follower catalog manager: success
I20260809 22:53:16.400239 13781 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: acquiring CA information for follower catalog manager: success
I20260809 22:53:16.401985 13781 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ac1585d7d944ce5a6bf15a473c6d717: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 22:53:16.715248 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 13381
I20260809 22:53:16.716501 13466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:16.834165 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 13381
W20260809 22:53:16.866616 13515 connection.cc:535] server connection from 127.0.0.1:42426 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 22:53:16.866938 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 13485
I20260809 22:53:16.868237 13578 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:16.979714 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 13485
I20260809 22:53:17.010031 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 13594
I20260809 22:53:17.011400 13703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:17.125110 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 13594
2026-08-09T22:53:17Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5247 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:53:17 dist-test-slave-92m1 krb5kdc[13835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:53:17 dist-test-slave-92m1 krb5kdc[13835](info): set up 2 sockets
Aug 09 22:53:17 dist-test-slave-92m1 krb5kdc[13835](info): commencing operation
krb5kdc: starting...
W20260809 22:53:18.489071 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:53:18 dist-test-slave-92m1 krb5kdc[13835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:53:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:53:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:53:18.847723 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41269
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:39743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:19.205855 13860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:19.206182 13860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:19.206310 13860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:19.213936 13860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:19.214047 13860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:19.214157 13860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:19.214247 13860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:19.214308 13860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:19.224249 13860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:39743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:19.225705 13860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:19.227171 13860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:19.240016 13867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:19.240025 13873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:19.240021 13869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:19.241004 13860 server_base.cc:1034] running on GCE node
I20260809 22:53:19.241763 13860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:19.243162 13860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:19.244441 13860 hybrid_clock.cc:648] HybridClock initialized: now 1786315999244384 us; error 38 us; skew 500 ppm
I20260809 22:53:19.244827 13860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:19 dist-test-slave-92m1 krb5kdc[13835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315999, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:19.253180 13860 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:19.254920 13860 webserver.cc:460] Webserver started at http://127.23.131.126:33761/ using document root <none> and password file <none>
I20260809 22:53:19.255738 13860 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:19.255888 13860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:19.256240 13860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:19.259418 13860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "3a3d8a733b854009be81a3f98438e037"
format_stamp: "Formatted at 2026-08-09 22:53:19 on dist-test-slave-92m1"
server_key: "f3f1e335682c9d8917501e176452f9c5"
server_key_iv: "e48a75d60c6d6b8fd42df6e400d28155"
server_key_version: "encryptionkey@0"
I20260809 22:53:19.260223 13860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "3a3d8a733b854009be81a3f98438e037"
format_stamp: "Formatted at 2026-08-09 22:53:19 on dist-test-slave-92m1"
server_key: "f3f1e335682c9d8917501e176452f9c5"
server_key_iv: "e48a75d60c6d6b8fd42df6e400d28155"
server_key_version: "encryptionkey@0"
I20260809 22:53:19.265978 13860 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 22:53:19.269906 13886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:19.271379 13860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:53:19.271605 13860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "3a3d8a733b854009be81a3f98438e037"
format_stamp: "Formatted at 2026-08-09 22:53:19 on dist-test-slave-92m1"
server_key: "f3f1e335682c9d8917501e176452f9c5"
server_key_iv: "e48a75d60c6d6b8fd42df6e400d28155"
server_key_version: "encryptionkey@0"
I20260809 22:53:19.271831 13860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:19.301692 13860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:19.306135 13860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:19.306464 13860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:19.327725 13860 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41269
I20260809 22:53:19.327759 13960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41269 every 8 connection(s)
I20260809 22:53:19.329210 13860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:19.333215 13961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:19.333551 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 13860
I20260809 22:53:19.333791 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:53:19.334513 24077 external_mini_cluster.cc:1428] Setting key d9dbc91f4206b7a33d7a343d4e78d3ef
I20260809 22:53:19.348188 13961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037: Bootstrap starting.
Aug 09 22:53:19 dist-test-slave-92m1 krb5kdc[13835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786315998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:19.352218 13961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:19.353597 13961 log.cc:824] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:19.356761 13961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037: No bootstrap required, opened a new log
I20260809 22:53:19.359817 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:19.336486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.23.131.126:41269)
0809 22:53:19.337317 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:19.337329 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:19.337371 (+ 42us) server_negotiation.cc:407] Connection header received
0809 22:53:19.339680 (+ 2309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:19.339704 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:19.340121 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:19.340464 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:19.342530 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:19.344002 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:19.345966 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:19.346657 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:19.346797 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:19.352071 (+ 5274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:19.352079 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:19.352098 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:19.352139 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:19.355421 (+ 3282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:19.356227 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:19.356235 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:19.356241 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:19.356426 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:19.356839 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:19.356845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:19.356848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:19.357428 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:19.357795 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:19.358224 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 22:53:19.358689 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":403,"threads_started":1}
I20260809 22:53:19.364006 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:53:19.365808 13961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3d8a733b854009be81a3f98438e037" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41269 } }
I20260809 22:53:19.366196 13961 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:19.366329 13961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a3d8a733b854009be81a3f98438e037, State: Initialized, Role: FOLLOWER
I20260809 22:53:19.367013 13961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3d8a733b854009be81a3f98438e037" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41269 } }
I20260809 22:53:19.367413 13961 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:19.367581 13961 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:19.367766 13961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:19.369989 13961 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3d8a733b854009be81a3f98438e037" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41269 } }
I20260809 22:53:19.370493 13961 leader_election.cc:302] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a3d8a733b854009be81a3f98438e037; no voters:
I20260809 22:53:19.371124 13961 leader_election.cc:288] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:53:19.371294 13967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:19.372011 13967 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [term 1 LEADER]: Becoming Leader. State: Replica: 3a3d8a733b854009be81a3f98438e037, State: Running, Role: LEADER
I20260809 22:53:19.372560 13967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3d8a733b854009be81a3f98438e037" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41269 } }
I20260809 22:53:19.373293 13961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:19.375644 13969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a3d8a733b854009be81a3f98438e037. Latest consensus state: current_term: 1 leader_uuid: "3a3d8a733b854009be81a3f98438e037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3d8a733b854009be81a3f98438e037" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41269 } } }
I20260809 22:53:19.376001 13969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:19.375644 13968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a3d8a733b854009be81a3f98438e037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a3d8a733b854009be81a3f98438e037" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41269 } } }
I20260809 22:53:19.376995 13968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:19.380728 13973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:19.386207 13973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:19.395000 13973 catalog_manager.cc:1347] Generated new cluster ID: 5c7e9cead1bd4bdaa6547abe42c296a8
I20260809 22:53:19.395131 13973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:19.422400 13973 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:53:19.423918 13973 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:19.437229 13973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a3d8a733b854009be81a3f98438e037: Generated new TSK 0
I20260809 22:53:19.438154 13973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:53:19.477262 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 13860
I20260809 22:53:19.478511 13953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:19.580717 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 13860
2026-08-09T22:53:19Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2445 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:53:19 dist-test-slave-92m1 krb5kdc[13996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:53:19 dist-test-slave-92m1 krb5kdc[13996](info): set up 2 sockets
Aug 09 22:53:19 dist-test-slave-92m1 krb5kdc[13996](info): commencing operation
krb5kdc: starting...
W20260809 22:53:20.952718 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.004s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:53:21 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:53:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:53:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:53:21.311800 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39753
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:21.675776 14015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:21.676141 14015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:21.676337 14015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:21.684274 14015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:21.684427 14015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:21.684540 14015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:21.684664 14015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:21.684748 14015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:21.695474 14015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:21.696895 14015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:21.698278 14015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:21.710963 14021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:21.711035 14031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:21.711066 14024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:21.711968 14015 server_base.cc:1034] running on GCE node
I20260809 22:53:21.712843 14015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:21.714881 14015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:21.716171 14015 hybrid_clock.cc:648] HybridClock initialized: now 1786316001716097 us; error 45 us; skew 500 ppm
I20260809 22:53:21.716645 14015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:21 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316001, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:21.721181 14015 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:21.724835 14015 webserver.cc:460] Webserver started at http://127.23.131.126:42369/ using document root <none> and password file <none>
I20260809 22:53:21.725600 14015 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:21.725739 14015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:21.726075 14015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:21.729202 14015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "b91dd443eef949c09a36c5715dc0f5eb"
format_stamp: "Formatted at 2026-08-09 22:53:21 on dist-test-slave-92m1"
server_key: "bed7805c63140bc5dd461222d9cfb3c7"
server_key_iv: "96a1daec08d996ca57eea4cb05527d00"
server_key_version: "encryptionkey@0"
I20260809 22:53:21.730042 14015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "b91dd443eef949c09a36c5715dc0f5eb"
format_stamp: "Formatted at 2026-08-09 22:53:21 on dist-test-slave-92m1"
server_key: "bed7805c63140bc5dd461222d9cfb3c7"
server_key_iv: "96a1daec08d996ca57eea4cb05527d00"
server_key_version: "encryptionkey@0"
I20260809 22:53:21.735440 14015 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:53:21.738873 14038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:21.740264 14015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:53:21.740453 14015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "b91dd443eef949c09a36c5715dc0f5eb"
format_stamp: "Formatted at 2026-08-09 22:53:21 on dist-test-slave-92m1"
server_key: "bed7805c63140bc5dd461222d9cfb3c7"
server_key_iv: "96a1daec08d996ca57eea4cb05527d00"
server_key_version: "encryptionkey@0"
I20260809 22:53:21.740667 14015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:21.754462 14015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:21.759254 14015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:21.759573 14015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:21.779716 14015 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:39753
I20260809 22:53:21.779767 14120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:39753 every 8 connection(s)
I20260809 22:53:21.781234 14015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:21.785410 14123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:21.786962 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 14015
I20260809 22:53:21.787250 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:53:21.787956 24077 external_mini_cluster.cc:1428] Setting key 94fdaa76493e21eff76c3808f3e599ed
I20260809 22:53:21.799034 14123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap starting.
I20260809 22:53:21.802911 14123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:21.804121 14123 log.cc:824] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:53:21 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:21.807937 14123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: No bootstrap required, opened a new log
I20260809 22:53:21.815826 14129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:21.790379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43296 (local address 127.23.131.126:39753)
0809 22:53:21.791481 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:21.791498 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:21.791918 (+ 420us) server_negotiation.cc:407] Connection header received
0809 22:53:21.794540 (+ 2622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:21.794580 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:21.795153 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:21.795676 (+ 523us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:21.797076 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:21.799120 (+ 2044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:21.800573 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:21.801716 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:21.801922 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:21.806353 (+ 4431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:21.806365 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:21.806385 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:21.806434 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:21.810675 (+ 4241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:21.811508 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:21.811521 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:21.811536 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:21.811786 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:21.812175 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:21.812180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:21.812184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:21.813016 (+ 832us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:21.813349 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:21.813705 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 22:53:21.814238 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":486,"threads_started":1}
I20260809 22:53:21.819350 14123 raft_consensus.cc:348] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:21.819726 14123 raft_consensus.cc:374] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:21.819808 14123 raft_consensus.cc:729] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91dd443eef949c09a36c5715dc0f5eb, State: Initialized, Role: FOLLOWER
I20260809 22:53:21.820320 14123 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:21.820529 14123 raft_consensus.cc:388] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:21.820653 14123 raft_consensus.cc:482] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:21.820777 14123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:21.823097 14123 raft_consensus.cc:504] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:21.823704 14123 leader_election.cc:302] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b91dd443eef949c09a36c5715dc0f5eb; no voters:
I20260809 22:53:21.824473 14123 leader_election.cc:288] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:53:21.824620 14132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:21.825464 14132 raft_consensus.cc:686] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 LEADER]: Becoming Leader. State: Replica: b91dd443eef949c09a36c5715dc0f5eb, State: Running, Role: LEADER
I20260809 22:53:21.826093 14132 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:21.826785 14123 sys_catalog.cc:564] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:21.829478 14136 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91dd443eef949c09a36c5715dc0f5eb. Latest consensus state: current_term: 1 leader_uuid: "b91dd443eef949c09a36c5715dc0f5eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } } }
I20260809 22:53:21.830143 14136 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:21.829489 14134 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b91dd443eef949c09a36c5715dc0f5eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } } }
I20260809 22:53:21.832402 14134 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:21.833988 14144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:21.840034 14144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:21.850236 14144 catalog_manager.cc:1347] Generated new cluster ID: 9ee1409531e044bd8aa03f534992b2dc
I20260809 22:53:21.850379 14144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:21.865548 14144 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:53:21.867122 14144 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:21.879244 14144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Generated new TSK 0
I20260809 22:53:21.880178 14144 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:53:21.964107 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39753
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:22.342317 14163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:22.342635 14163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:22.342837 14163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:22.350584 14163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:22.350701 14163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:22.350872 14163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:53:22.361142 14163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:22.362546 14163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:22.363965 14163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:22.378137 14172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:22.378101 14173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:22.378192 14177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:22.379876 14163 server_base.cc:1034] running on GCE node
I20260809 22:53:22.380599 14163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:22.381642 14163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:22.382849 14163 hybrid_clock.cc:648] HybridClock initialized: now 1786316002382802 us; error 37 us; skew 500 ppm
I20260809 22:53:22.383236 14163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:22 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316002, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:22.386673 14163 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:53:22.388193 14163 webserver.cc:460] Webserver started at http://127.23.131.65:34629/ using document root <none> and password file <none>
I20260809 22:53:22.388883 14163 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:22.388988 14163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:22.389245 14163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:22.392508 14163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "665a3ceab2454c04b0b078a35c0e4424"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "f6e8761dc2e734eb453513cedc730f32"
server_key_iv: "b36389b6886112b2a7fb5a777f550848"
server_key_version: "encryptionkey@0"
I20260809 22:53:22.393350 14163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "665a3ceab2454c04b0b078a35c0e4424"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "f6e8761dc2e734eb453513cedc730f32"
server_key_iv: "b36389b6886112b2a7fb5a777f550848"
server_key_version: "encryptionkey@0"
I20260809 22:53:22.398916 14163 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:53:22.402601 14186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:22.404042 14163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:53:22.404254 14163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "665a3ceab2454c04b0b078a35c0e4424"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "f6e8761dc2e734eb453513cedc730f32"
server_key_iv: "b36389b6886112b2a7fb5a777f550848"
server_key_version: "encryptionkey@0"
I20260809 22:53:22.404489 14163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:22.419469 14163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:22.424281 14163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:22.424614 14163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:22.425707 14163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:22.427138 14163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:22.427275 14163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 22:53:22.427429 14163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:22.427508 14163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:22.462986 14163 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:45373
I20260809 22:53:22.463029 14346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:45373 every 8 connection(s)
I20260809 22:53:22.464380 14163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:53:22.471938 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 14163
I20260809 22:53:22.472196 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:53:22.473048 24077 external_mini_cluster.cc:1428] Setting key dcc25c37e8cd1ec16f1f39e4f6592518
Aug 09 22:53:22 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316002, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:22.485921 14350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:22.467099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:41427 (local address 127.23.131.126:39753)
0809 22:53:22.467652 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:22.467657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:22.468504 (+ 847us) server_negotiation.cc:407] Connection header received
0809 22:53:22.470354 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:22.470360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:22.470446 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:22.470569 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:22.472588 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:22.473504 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:22.475515 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:22.475923 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:22.476082 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:22.480000 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:22.480005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:22.480008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:22.480048 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:22.482671 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:22.483533 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:22.483544 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:22.483546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:22.483666 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:22.484127 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:22.484132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:22.484134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:22.484403 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:22.484566 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:22.485301 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 22:53:22.485544 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":320,"threads_started":1}
I20260809 22:53:22.486871 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:22.467597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:41427)
0809 22:53:22.468316 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:22.468389 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:22.470052 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:22.470823 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:22.470831 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:22.471539 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:22.472389 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:22.472417 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:22.473744 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:22.473750 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:22.475351 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:22.475364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:22.476175 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:22.476184 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:22.476423 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:22.477161 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:22.477185 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:22.479759 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:22.482827 (+ 3068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:22.482837 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:22.482855 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:22.483401 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:22.483785 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:22.483790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:22.483793 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:22.483995 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:22.484546 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:22.484554 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:22.484910 (+ 356us) client_negotiation.cc:769] Sending connection context
0809 22:53:22.485184 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 22:53:22.485768 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":285,"threads_started":1}
I20260809 22:53:22.488477 14348 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39753
I20260809 22:53:22.488816 14348 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:22.489570 14348 heartbeater.cc:511] Master 127.23.131.126:39753 requested a full tablet report, sending...
I20260809 22:53:22.492030 14065 ts_manager.cc:194] Registered new tserver with Master: 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65:45373)
I20260809 22:53:22.493587 14065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:41427
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:53:22.548570 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39753
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:22.913708 14355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:22.914019 14355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:22.914230 14355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:22.921871 14355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:22.922004 14355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:22.922225 14355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:53:22.933053 14355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:22.934501 14355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:22.935900 14355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:22.949608 14364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:22.949609 14365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:22.949898 14371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:22.950358 14355 server_base.cc:1034] running on GCE node
I20260809 22:53:22.951014 14355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:22.952020 14355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:22.953233 14355 hybrid_clock.cc:648] HybridClock initialized: now 1786316002953174 us; error 45 us; skew 500 ppm
I20260809 22:53:22.953512 14355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:22 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316002, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:22.956871 14355 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:53:22.958437 14355 webserver.cc:460] Webserver started at http://127.23.131.66:32971/ using document root <none> and password file <none>
I20260809 22:53:22.959180 14355 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:22.959393 14355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:22.959725 14355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:22.962822 14355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "61a0e8b93d97ee6386349891bee8d296"
server_key_iv: "791a1c003da600a63b066f374ab241b9"
server_key_version: "encryptionkey@0"
I20260809 22:53:22.963728 14355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "61a0e8b93d97ee6386349891bee8d296"
server_key_iv: "791a1c003da600a63b066f374ab241b9"
server_key_version: "encryptionkey@0"
I20260809 22:53:22.969461 14355 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:53:22.973449 14378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:22.974924 14355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:53:22.975126 14355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "61a0e8b93d97ee6386349891bee8d296"
server_key_iv: "791a1c003da600a63b066f374ab241b9"
server_key_version: "encryptionkey@0"
I20260809 22:53:22.975417 14355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:23.009676 14355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:23.014102 14355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:23.014429 14355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:23.015509 14355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:23.016887 14355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:23.016963 14355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:23.017056 14355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:23.017102 14355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:23.053236 14355 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46693
I20260809 22:53:23.053293 14556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46693 every 8 connection(s)
I20260809 22:53:23.054618 14355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:53:23.064828 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 14355
I20260809 22:53:23.065025 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:53:23.065659 24077 external_mini_cluster.cc:1428] Setting key 4b8ac29317bdc449ac1eb2bb94c2f8bc
Aug 09 22:53:23 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316002, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:23.077239 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.057279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:51251 (local address 127.23.131.126:39753)
0809 22:53:23.057744 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:23.057748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:23.058753 (+ 1005us) server_negotiation.cc:407] Connection header received
0809 22:53:23.060664 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:23.060668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:23.060740 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:23.060840 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:23.062391 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.063124 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.064768 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.065428 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.065579 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.069606 (+ 4027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:23.069616 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:23.069624 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:23.069675 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:23.073542 (+ 3867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:23.074391 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:23.074400 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:23.074406 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:23.074591 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:23.075055 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:23.075060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:23.075064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:23.075511 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:23.075682 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:23.076451 (+ 769us) server_negotiation.cc:299] Negotiation successful
0809 22:53:23.076741 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":239,"threads_started":1}
I20260809 22:53:23.077893 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.057886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:51251)
0809 22:53:23.058576 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:23.058621 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:23.060397 (+ 1776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:23.061067 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:23.061075 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:23.061625 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:23.062226 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.062244 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.063324 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.063327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.064613 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.064625 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.065649 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.065654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.065914 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.066640 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:23.066669 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:23.069336 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:23.073725 (+ 4389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:23.073733 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:23.073748 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:23.074243 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:23.074715 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:23.074719 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:23.074721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:23.074927 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:23.075666 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:23.075672 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:23.076054 (+ 382us) client_negotiation.cc:769] Sending connection context
0809 22:53:23.076294 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 22:53:23.076716 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":290,"threads_started":1}
I20260809 22:53:23.079553 14558 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39753
I20260809 22:53:23.079941 14558 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:23.080973 14558 heartbeater.cc:511] Master 127.23.131.126:39753 requested a full tablet report, sending...
I20260809 22:53:23.082722 14065 ts_manager.cc:194] Registered new tserver with Master: bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
I20260809 22:53:23.083658 14065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:51251
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:53:23.146612 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39753
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:23.496851 14348 heartbeater.cc:503] Master 127.23.131.126:39753 was elected leader, sending a full tablet report...
W20260809 22:53:23.511049 14565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:23.511441 14565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:23.511621 14565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:23.519055 14565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:23.519251 14565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:23.519445 14565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:53:23.532976 14565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:23.534796 14565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:23.536536 14565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:23.554961 14573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:23.555025 14576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:23.555168 14574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:23.556416 14565 server_base.cc:1034] running on GCE node
I20260809 22:53:23.557243 14565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:23.558307 14565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:23.559517 14565 hybrid_clock.cc:648] HybridClock initialized: now 1786316003559464 us; error 38 us; skew 500 ppm
I20260809 22:53:23.559862 14565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:23 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316003, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:23.563437 14565 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:53:23.565088 14565 webserver.cc:460] Webserver started at http://127.23.131.67:42681/ using document root <none> and password file <none>
I20260809 22:53:23.565837 14565 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:23.565994 14565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:23.566321 14565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:23.569581 14565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "a42e645a1d69439da84af9096fe33123"
format_stamp: "Formatted at 2026-08-09 22:53:23 on dist-test-slave-92m1"
server_key: "29bea57d625b6c126aff9e5bbb7b3585"
server_key_iv: "20039a82cbf89c0da5bc12ff37316682"
server_key_version: "encryptionkey@0"
I20260809 22:53:23.570472 14565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "a42e645a1d69439da84af9096fe33123"
format_stamp: "Formatted at 2026-08-09 22:53:23 on dist-test-slave-92m1"
server_key: "29bea57d625b6c126aff9e5bbb7b3585"
server_key_iv: "20039a82cbf89c0da5bc12ff37316682"
server_key_version: "encryptionkey@0"
I20260809 22:53:23.576396 14565 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:53:23.580524 14586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:23.581995 14565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:53:23.582216 14565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "a42e645a1d69439da84af9096fe33123"
format_stamp: "Formatted at 2026-08-09 22:53:23 on dist-test-slave-92m1"
server_key: "29bea57d625b6c126aff9e5bbb7b3585"
server_key_iv: "20039a82cbf89c0da5bc12ff37316682"
server_key_version: "encryptionkey@0"
I20260809 22:53:23.582504 14565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:23.599032 14565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:23.603614 14565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:23.603947 14565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:23.605072 14565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:23.606547 14565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:23.606660 14565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:23.606848 14565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:23.606933 14565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:23.644115 14565 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:44939
I20260809 22:53:23.644192 14761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:44939 every 8 connection(s)
I20260809 22:53:23.645884 14565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:53:23.657850 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 14565
I20260809 22:53:23.658085 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:53:23.658674 24077 external_mini_cluster.cc:1428] Setting key 03948f574871463840d5b47191511faf
Aug 09 22:53:23 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316003, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:23.670449 14765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.648865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:50793 (local address 127.23.131.126:39753)
0809 22:53:23.649452 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:23.649459 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:23.650877 (+ 1418us) server_negotiation.cc:407] Connection header received
0809 22:53:23.654095 (+ 3218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:23.654104 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:23.654208 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:23.654321 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:23.656721 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.658154 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.660217 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.660843 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.660999 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.664854 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:23.664860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:23.664863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:23.664910 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:23.667597 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:23.668341 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:23.668345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:23.668347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:23.668469 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:23.668872 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:23.668876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:23.668878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:23.669162 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:23.669280 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:23.669971 (+ 691us) server_negotiation.cc:299] Negotiation successful
0809 22:53:23.670150 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":352,"threads_started":1}
I20260809 22:53:23.671546 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.649525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:50793)
0809 22:53:23.650656 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:23.650732 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:23.653650 (+ 2918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:23.654726 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:23.654745 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:23.655823 (+ 1078us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:23.656500 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.656519 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.658334 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.658340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.659993 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.660007 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.661133 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.661140 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.661359 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.662202 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:23.662226 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:23.664573 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:23.667738 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:23.667746 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:23.667760 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:23.668225 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:23.668564 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:23.668568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:23.668572 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:23.668769 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:23.669270 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:23.669276 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:23.669620 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 22:53:23.669848 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 22:53:23.670283 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":403,"threads_started":1}
I20260809 22:53:23.673372 14762 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39753
I20260809 22:53:23.673744 14762 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:23.674772 14762 heartbeater.cc:511] Master 127.23.131.126:39753 requested a full tablet report, sending...
I20260809 22:53:23.676483 14065 ts_manager.cc:194] Registered new tserver with Master: a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939)
I20260809 22:53:23.677328 14065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:50793
I20260809 22:53:23.687876 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:53:23.705883 14765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.692920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43302 (local address 127.23.131.126:39753)
0809 22:53:23.693186 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:23.693194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:23.693544 (+ 350us) server_negotiation.cc:407] Connection header received
0809 22:53:23.693710 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:23.693714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:23.693787 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:23.693877 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:23.695496 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.696302 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.697622 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.698057 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.698168 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.700806 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:23.700811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:23.700814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:23.700851 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:23.703465 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:23.704112 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:23.704115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:23.704118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:23.704248 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:23.704577 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:23.704580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:23.704582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:23.704902 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:23.705092 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:23.705382 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 22:53:23.705561 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 22:53:23.710525 14065 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:53:23.717563 14065 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:53:23.742748 14784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.730547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46693 (local address 127.0.0.1:47610)
0809 22:53:23.731626 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:23.731681 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:23.731907 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:23.734592 (+ 2685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:23.734600 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:23.734649 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:23.735077 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.735099 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.737135 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.737142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.739618 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.739633 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.741642 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.741649 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.741858 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.741914 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 22:53:23.742024 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 22:53:23.742216 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":1,"thread_start_us":690,"threads_started":1}
I20260809 22:53:23.743592 14787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.731001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44939 (local address 127.0.0.1:51944)
0809 22:53:23.733380 (+ 2379us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:23.733404 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:23.733547 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:23.735974 (+ 2427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:23.735979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:23.736005 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:23.736442 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.736454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.738660 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.738665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.740877 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.740893 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.742777 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.742786 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.742968 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.743000 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:53:23.743082 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 22:53:23.743245 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2210,"thread_start_us":2015,"threads_started":1}
I20260809 22:53:23.744350 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.730856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47610 (local address 127.23.131.66:46693)
0809 22:53:23.734070 (+ 3214us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:23.734081 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:23.734109 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:53:23.734194 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:23.734200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:23.734371 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:23.734577 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:23.735338 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.736964 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.739864 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.741384 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.743402 (+ 2018us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.743630 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:23.743849 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 22:53:23.744025 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3071,"thread_start_us":2956,"threads_started":1}
I20260809 22:53:23.744748 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.731060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51944 (local address 127.23.131.67:44939)
0809 22:53:23.735379 (+ 4319us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:23.735388 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:23.735422 (+ 34us) server_negotiation.cc:407] Connection header received
0809 22:53:23.735518 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:23.735527 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:23.735758 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:23.736629 (+ 871us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:23.736878 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.738506 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.741109 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.742514 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.743884 (+ 1370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.744110 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:23.744182 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 22:53:23.744352 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4097,"thread_start_us":4319,"threads_started":1}
I20260809 22:53:23.749140 14655 tablet_service.cc:1467] Processing CreateTablet for tablet 9ea274f033204ecdbe3808b7f5424b43 (DEFAULT_TABLE table=test-table [id=085476a18ac74127a7a07a9380ff0786]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:23.749410 14453 tablet_service.cc:1467] Processing CreateTablet for tablet 9ea274f033204ecdbe3808b7f5424b43 (DEFAULT_TABLE table=test-table [id=085476a18ac74127a7a07a9380ff0786]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:23.750627 14453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ea274f033204ecdbe3808b7f5424b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:23.750720 14655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ea274f033204ecdbe3808b7f5424b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:23.752677 14784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.733216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:55640)
0809 22:53:23.743004 (+ 9788us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:23.743023 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:23.743121 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:23.745754 (+ 2633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:23.745758 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:23.745782 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:23.745970 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.745984 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.748019 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.748024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.749809 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:23.749828 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.751840 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.751848 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:23.752039 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.752079 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:53:23.752156 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 22:53:23.752327 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9693,"thread_start_us":12683,"threads_started":1}
I20260809 22:53:23.753491 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:23.733546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55640 (local address 127.23.131.65:45373)
0809 22:53:23.744708 (+ 11162us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:23.744721 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:23.744759 (+ 38us) server_negotiation.cc:407] Connection header received
0809 22:53:23.744901 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:23.744909 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:23.745180 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:23.745775 (+ 595us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:23.746155 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.747844 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.750039 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:23.751622 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:23.752631 (+ 1009us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:23.752912 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:23.752993 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 22:53:23.753160 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10821,"thread_start_us":9911,"threads_started":1}
I20260809 22:53:23.757833 14250 tablet_service.cc:1467] Processing CreateTablet for tablet 9ea274f033204ecdbe3808b7f5424b43 (DEFAULT_TABLE table=test-table [id=085476a18ac74127a7a07a9380ff0786]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:23.759541 14250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ea274f033204ecdbe3808b7f5424b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:23.764489 14791 tablet_bootstrap.cc:492] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Bootstrap starting.
I20260809 22:53:23.766673 14792 tablet_bootstrap.cc:492] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Bootstrap starting.
I20260809 22:53:23.769610 14791 tablet_bootstrap.cc:654] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:23.770855 14792 tablet_bootstrap.cc:654] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:23.771056 14791 log.cc:824] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:23.772186 14792 log.cc:824] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:23.774238 14796 tablet_bootstrap.cc:492] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Bootstrap starting.
I20260809 22:53:23.774737 14791 tablet_bootstrap.cc:492] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: No bootstrap required, opened a new log
I20260809 22:53:23.775040 14791 ts_tablet_manager.cc:1397] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260809 22:53:23.775945 14792 tablet_bootstrap.cc:492] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: No bootstrap required, opened a new log
I20260809 22:53:23.776260 14792 ts_tablet_manager.cc:1397] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 22:53:23.779829 14796 tablet_bootstrap.cc:654] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:23.781469 14796 log.cc:824] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:23.785205 14791 raft_consensus.cc:348] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:23.785897 14791 raft_consensus.cc:374] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:23.786039 14791 raft_consensus.cc:729] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd68d09e9cd54f3c8d1a66779f27f1ab, State: Initialized, Role: FOLLOWER
I20260809 22:53:23.786916 14791 consensus_queue.cc:260] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:23.789784 14792 raft_consensus.cc:348] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:23.790419 14792 raft_consensus.cc:374] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:23.790673 14792 raft_consensus.cc:729] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42e645a1d69439da84af9096fe33123, State: Initialized, Role: FOLLOWER
I20260809 22:53:23.791617 14792 consensus_queue.cc:260] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:23.793648 14796 tablet_bootstrap.cc:492] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: No bootstrap required, opened a new log
I20260809 22:53:23.794068 14796 ts_tablet_manager.cc:1397] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.007s
I20260809 22:53:23.795684 14558 heartbeater.cc:503] Master 127.23.131.126:39753 was elected leader, sending a full tablet report...
I20260809 22:53:23.795776 14791 ts_tablet_manager.cc:1428] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Time spent starting tablet: real 0.021s user 0.013s sys 0.010s
I20260809 22:53:23.799336 14792 ts_tablet_manager.cc:1428] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Time spent starting tablet: real 0.023s user 0.012s sys 0.007s
I20260809 22:53:23.799940 14762 heartbeater.cc:503] Master 127.23.131.126:39753 was elected leader, sending a full tablet report...
I20260809 22:53:23.806260 14796 raft_consensus.cc:348] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:23.806689 14796 raft_consensus.cc:374] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:23.806845 14796 raft_consensus.cc:729] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665a3ceab2454c04b0b078a35c0e4424, State: Initialized, Role: FOLLOWER
W20260809 22:53:23.807073 14559 tablet.cc:2369] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:23.807646 14796 consensus_queue.cc:260] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:23.809666 14796 ts_tablet_manager.cc:1428] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Time spent starting tablet: real 0.015s user 0.014s sys 0.002s
W20260809 22:53:23.898207 14763 tablet.cc:2369] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:53:23.967124 14349 tablet.cc:2369] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:24.034821 14804 raft_consensus.cc:482] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:24.035188 14804 raft_consensus.cc:504] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:24.036986 14804 leader_election.cc:288] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693), a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939)
I20260809 22:53:24.045033 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.037582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:40577 (local address 127.23.131.66:46693)
0809 22:53:24.037804 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:24.037811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:24.038867 (+ 1056us) server_negotiation.cc:407] Connection header received
0809 22:53:24.039124 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:24.039129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:24.039243 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:24.039345 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:24.039952 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.040767 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.043000 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.043921 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.044104 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.044191 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:24.044598 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 22:53:24.044739 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:53:24.045034 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.037589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:35929 (local address 127.23.131.67:44939)
0809 22:53:24.037805 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:24.037810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:24.038711 (+ 901us) server_negotiation.cc:407] Connection header received
0809 22:53:24.038878 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:24.038883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:24.038970 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:24.039066 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:24.039823 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.040803 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.042957 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.043862 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.044085 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.044171 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:24.044618 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 22:53:24.044759 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:53:24.045310 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.037583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46693 (local address 127.23.131.65:40577)
0809 22:53:24.038751 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:24.038768 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:24.038921 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:24.039359 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:24.039362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:24.039382 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:24.039752 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:24.039768 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.040922 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.040928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:24.042829 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:24.042842 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.044169 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.044176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:24.044408 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.044432 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 22:53:24.044556 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 22:53:24.044768 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026,"mutex_wait_us":84,"spinlock_wait_cycles":29952,"thread_start_us":568,"threads_started":1}
I20260809 22:53:24.045336 14805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.037583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44939 (local address 127.23.131.65:35929)
0809 22:53:24.038580 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:24.038598 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:24.038735 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:24.039123 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:24.039128 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:24.039156 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:24.039660 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:24.039670 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.040973 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.040982 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:24.042791 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:24.042804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.044123 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.044131 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:24.044355 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.044416 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 22:53:24.044587 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 22:53:24.044741 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"mutex_wait_us":37,"thread_start_us":657,"threads_started":1}
I20260809 22:53:24.046744 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ea274f033204ecdbe3808b7f5424b43" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" is_pre_election: true
I20260809 22:53:24.046744 14680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ea274f033204ecdbe3808b7f5424b43" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42e645a1d69439da84af9096fe33123" is_pre_election: true
I20260809 22:53:24.047423 14680 raft_consensus.cc:2454] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 0.
I20260809 22:53:24.047416 14483 raft_consensus.cc:2454] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 0.
I20260809 22:53:24.048223 14190 leader_election.cc:302] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424, a42e645a1d69439da84af9096fe33123, bd68d09e9cd54f3c8d1a66779f27f1ab; no voters:
I20260809 22:53:24.048748 14804 raft_consensus.cc:2781] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:53:24.048915 14804 raft_consensus.cc:482] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:53:24.049038 14804 raft_consensus.cc:3037] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:24.051383 14804 raft_consensus.cc:504] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:24.052021 14804 leader_election.cc:288] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 election: Requested vote from peers bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693), a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939)
I20260809 22:53:24.052518 14680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ea274f033204ecdbe3808b7f5424b43" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42e645a1d69439da84af9096fe33123"
I20260809 22:53:24.052528 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ea274f033204ecdbe3808b7f5424b43" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
I20260809 22:53:24.052768 14680 raft_consensus.cc:3037] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:24.052871 14483 raft_consensus.cc:3037] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:24.055099 14680 raft_consensus.cc:2454] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 1.
I20260809 22:53:24.055578 14190 leader_election.cc:302] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424, a42e645a1d69439da84af9096fe33123; no voters:
I20260809 22:53:24.055876 14804 raft_consensus.cc:2781] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:24.056427 14483 raft_consensus.cc:2454] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 1.
I20260809 22:53:24.056890 14804 raft_consensus.cc:686] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 LEADER]: Becoming Leader. State: Replica: 665a3ceab2454c04b0b078a35c0e4424, State: Running, Role: LEADER
I20260809 22:53:24.057410 14804 consensus_queue.cc:237] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } }
I20260809 22:53:24.062225 14065 catalog_manager.cc:5495] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65). New cstate: current_term: 1 leader_uuid: "665a3ceab2454c04b0b078a35c0e4424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } health_report { overall_health: HEALTHY } } }
I20260809 22:53:24.125910 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.120776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55650 (local address 127.23.131.65:45373)
0809 22:53:24.120970 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:24.120975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:24.120998 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:53:24.121134 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:24.121138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:24.121239 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:24.121359 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:53:24.121725 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.122472 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.123875 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.124291 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.124383 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.124854 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:53:24.125367 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:53:24.125474 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:24.125589 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 22:53:24.125660 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:53:24.134742 14680 raft_consensus.cc:1261] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Refusing update from remote peer 665a3ceab2454c04b0b078a35c0e4424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:24.134742 14483 raft_consensus.cc:1261] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Refusing update from remote peer 665a3ceab2454c04b0b078a35c0e4424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:24.135931 14807 consensus_queue.cc:1035] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:24.136320 14804 consensus_queue.cc:1035] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:24.163524 14065 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:24.163796 14065 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:24.167587 14065 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Sending DeleteTablet for 3 replicas of tablet 9ea274f033204ecdbe3808b7f5424b43
I20260809 22:53:24.168905 14250 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ea274f033204ecdbe3808b7f5424b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:24 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:55640
I20260809 22:53:24.168944 14655 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ea274f033204ecdbe3808b7f5424b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:24 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:51944
I20260809 22:53:24.169123 14453 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ea274f033204ecdbe3808b7f5424b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:24 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:47610
I20260809 22:53:24.169226 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 14163
I20260809 22:53:24.198383 14825 tablet_replica.cc:330] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: stopping tablet replica
I20260809 22:53:24.198625 14827 tablet_replica.cc:330] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: stopping tablet replica
I20260809 22:53:24.199088 14825 raft_consensus.cc:2229] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:53:24.199155 14827 raft_consensus.cc:2229] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:24.199993 14825 raft_consensus.cc:2258] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:24.200031 14827 raft_consensus.cc:2258] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:24.200914 14826 tablet_replica.cc:330] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: stopping tablet replica
I20260809 22:53:24.201363 14826 raft_consensus.cc:2229] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:24.203482 14827 ts_tablet_manager.cc:1905] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:24.203495 14825 ts_tablet_manager.cc:1905] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:24.204655 14826 raft_consensus.cc:2258] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:24.207501 14826 ts_tablet_manager.cc:1905] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:24.211508 14827 ts_tablet_manager.cc:1918] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:24.211544 14825 ts_tablet_manager.cc:1918] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:24.211728 14825 log.cc:1196] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/9ea274f033204ecdbe3808b7f5424b43
I20260809 22:53:24.211755 14827 log.cc:1196] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/9ea274f033204ecdbe3808b7f5424b43
I20260809 22:53:24.212399 14827 ts_tablet_manager.cc:1939] T 9ea274f033204ecdbe3808b7f5424b43 P bd68d09e9cd54f3c8d1a66779f27f1ab: Deleting consensus metadata
I20260809 22:53:24.212404 14825 ts_tablet_manager.cc:1939] T 9ea274f033204ecdbe3808b7f5424b43 P 665a3ceab2454c04b0b078a35c0e4424: Deleting consensus metadata
Aug 09 22:53:24 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:53:24.214591 14041 catalog_manager.cc:4841] TS bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): tablet 9ea274f033204ecdbe3808b7f5424b43 (table test-table [id=085476a18ac74127a7a07a9380ff0786]) successfully deleted
I20260809 22:53:24.214983 14041 catalog_manager.cc:4841] TS 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65:45373): tablet 9ea274f033204ecdbe3808b7f5424b43 (table test-table [id=085476a18ac74127a7a07a9380ff0786]) successfully deleted
I20260809 22:53:24.216014 14826 ts_tablet_manager.cc:1918] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:24.216187 14826 log.cc:1196] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/9ea274f033204ecdbe3808b7f5424b43
I20260809 22:53:24.216713 14826 ts_tablet_manager.cc:1939] T 9ea274f033204ecdbe3808b7f5424b43 P a42e645a1d69439da84af9096fe33123: Deleting consensus metadata
I20260809 22:53:24.218665 14043 catalog_manager.cc:4841] TS a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): tablet 9ea274f033204ecdbe3808b7f5424b43 (table test-table [id=085476a18ac74127a7a07a9380ff0786]) successfully deleted
I20260809 22:53:24.222967 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.170648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55666 (local address 127.23.131.65:45373)
0809 22:53:24.170886 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:24.170896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:24.193941 (+ 23045us) server_negotiation.cc:407] Connection header received
0809 22:53:24.194647 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:24.194658 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:24.194781 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:24.194902 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:24.200501 (+ 5599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.201790 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.204042 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.204909 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.205049 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.215556 (+ 10507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:24.215572 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:24.215591 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:24.215656 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:24.219684 (+ 4028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:24.220645 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:24.220652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:24.220655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:24.220812 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:24.221305 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:24.221310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:24.221312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:24.221698 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:24.221972 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:24.222430 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 22:53:24.222632 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 22:53:24.224066 14342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:24.327510 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 14163
I20260809 22:53:24.355995 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 14355
Aug 09 22:53:24 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:53:24.381206 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.356785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48136 (local address 127.23.131.66:46693)
0809 22:53:24.356983 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:24.356987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:24.357006 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:53:24.357154 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:24.357158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:24.357219 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:24.357310 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:24.358614 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.359428 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.360702 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.361085 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.361175 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.374952 (+ 13777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:24.374973 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:24.374991 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:24.375039 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:24.378204 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:24.379150 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:24.379158 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:24.379160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:24.379349 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:24.379707 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:24.379710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:24.379712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:24.380148 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:24.380374 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:24.380661 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 22:53:24.380834 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:53:24.381887 14551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:24.474213 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 14355
I20260809 22:53:24.500073 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 14565
Aug 09 22:53:24 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:53:24.515025 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:24.500880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.23.131.67:44939)
0809 22:53:24.501061 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:24.501066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:24.501084 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:53:24.501226 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:24.501230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:24.501297 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:24.501385 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:24.502582 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.503383 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.504611 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:24.504977 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:24.505067 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:24.509432 (+ 4365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:24.509450 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:24.509466 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:24.509507 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:24.512517 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:24.513240 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:24.513247 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:24.513249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:24.513385 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:24.513744 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:24.513747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:24.513749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:24.514114 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:24.514342 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:24.514585 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 22:53:24.514755 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 22:53:24.515709 14752 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:24.608151 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 14565
I20260809 22:53:24.637073 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 14015
I20260809 22:53:24.638270 14112 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:24.752457 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 14015
I20260809 22:53:24.786891 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39753
--webserver_interface=127.23.131.126
--webserver_port=42369
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:25.159595 14834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:25.159993 14834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:25.160156 14834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:25.167737 14834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:25.167906 14834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:25.168022 14834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:25.168130 14834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:25.168216 14834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:25.179471 14834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=42369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:25.180936 14834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:25.182335 14834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:25.210456 14848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:25.210536 14854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:25.210561 14851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:25.211376 14834 server_base.cc:1034] running on GCE node
I20260809 22:53:25.212268 14834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:25.213912 14834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:25.215137 14834 hybrid_clock.cc:648] HybridClock initialized: now 1786316005215083 us; error 37 us; skew 500 ppm
I20260809 22:53:25.215631 14834 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:25 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316005, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:25.219503 14834 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:25.221344 14834 webserver.cc:460] Webserver started at http://127.23.131.126:42369/ using document root <none> and password file <none>
I20260809 22:53:25.222146 14834 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:25.222321 14834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:25.228559 14834 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 22:53:25.231709 14867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:25.233107 14834 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:53:25.233300 14834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "b91dd443eef949c09a36c5715dc0f5eb"
format_stamp: "Formatted at 2026-08-09 22:53:21 on dist-test-slave-92m1"
server_key: "bed7805c63140bc5dd461222d9cfb3c7"
server_key_iv: "96a1daec08d996ca57eea4cb05527d00"
server_key_version: "encryptionkey@0"
I20260809 22:53:25.234458 14834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:25.246685 14834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:25.251570 14834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:25.251879 14834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:25.272552 14834 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:39753
I20260809 22:53:25.272571 14945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:39753 every 8 connection(s)
I20260809 22:53:25.274210 14834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:25.277622 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 14834
I20260809 22:53:25.278731 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:45373
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:39753
--webserver_port=34629
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:25.283872 14946 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:53:25.289367 14946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap starting.
I20260809 22:53:25.313259 14946 log.cc:824] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:25.325874 14946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:53:25.326467 14946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap complete.
I20260809 22:53:25.336515 14946 raft_consensus.cc:348] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:25.337430 14946 raft_consensus.cc:729] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91dd443eef949c09a36c5715dc0f5eb, State: Initialized, Role: FOLLOWER
I20260809 22:53:25.338127 14946 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:25.338403 14946 raft_consensus.cc:388] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:25.338551 14946 raft_consensus.cc:482] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:25.338760 14946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 1 FOLLOWER]: Advancing to term 2
I20260809 22:53:25.342892 14946 raft_consensus.cc:504] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:25.343492 14946 leader_election.cc:302] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b91dd443eef949c09a36c5715dc0f5eb; no voters:
I20260809 22:53:25.344204 14946 leader_election.cc:288] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 22:53:25.344370 14951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Leader election won for term 2
I20260809 22:53:25.345826 14951 raft_consensus.cc:686] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 LEADER]: Becoming Leader. State: Replica: b91dd443eef949c09a36c5715dc0f5eb, State: Running, Role: LEADER
I20260809 22:53:25.346386 14951 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:25.346731 14946 sys_catalog.cc:564] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:25.349255 14953 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b91dd443eef949c09a36c5715dc0f5eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } } }
I20260809 22:53:25.349784 14953 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:25.353714 14955 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91dd443eef949c09a36c5715dc0f5eb. Latest consensus state: current_term: 2 leader_uuid: "b91dd443eef949c09a36c5715dc0f5eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } } }
I20260809 22:53:25.354085 14955 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:25.355623 14965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:25.366534 14965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:25.368580 14965 catalog_manager.cc:1259] Loaded cluster ID: 9ee1409531e044bd8aa03f534992b2dc
I20260809 22:53:25.368739 14965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:25.373611 14965 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 22:53:25.392957 14965 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 22:53:25.403416 14965 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:25.405223 14965 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Loaded TSK: 0
I20260809 22:53:25.406739 14965 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 22:53:25.661947 14948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:25.662261 14948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:25.662410 14948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:25.670030 14948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:25.670156 14948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:25.670361 14948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:53:25.680948 14948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:45373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=34629
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:25.682368 14948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:25.683825 14948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:25.697522 14986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:25.697542 14988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:25.698380 14991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:25.698556 14948 server_base.cc:1034] running on GCE node
I20260809 22:53:25.699316 14948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:25.700383 14948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:25.701614 14948 hybrid_clock.cc:648] HybridClock initialized: now 1786316005701544 us; error 56 us; skew 500 ppm
I20260809 22:53:25.701974 14948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:25 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316005, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:25.705363 14948 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:53:25.707005 14948 webserver.cc:460] Webserver started at http://127.23.131.65:34629/ using document root <none> and password file <none>
I20260809 22:53:25.707760 14948 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:25.707916 14948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:25.713515 14948 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 22:53:25.716830 15000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:25.718348 14948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:53:25.718544 14948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "665a3ceab2454c04b0b078a35c0e4424"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "f6e8761dc2e734eb453513cedc730f32"
server_key_iv: "b36389b6886112b2a7fb5a777f550848"
server_key_version: "encryptionkey@0"
I20260809 22:53:25.719651 14948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:25.739005 14948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:25.743683 14948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:25.743984 14948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:25.745150 14948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:25.746671 14948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:25.746802 14948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:25.746945 14948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:25.747033 14948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:25.782546 14948 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:45373
I20260809 22:53:25.782617 15172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:45373 every 8 connection(s)
I20260809 22:53:25.784039 14948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:53:25.786442 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 14948
I20260809 22:53:25.787359 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:46693
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:39753
--webserver_port=32971
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:53:25 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316005, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:25.812790 15178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:25.787251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:53839)
0809 22:53:25.788483 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:25.788535 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:25.791294 (+ 2759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:25.793097 (+ 1803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:25.793110 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:25.793942 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:25.794751 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:25.794783 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:25.796601 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:25.796609 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:25.798741 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:25.798760 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:25.799955 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:25.799965 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:25.800317 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:25.801112 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:25.801147 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:25.803882 (+ 2735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:25.807792 (+ 3910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:25.807803 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:25.807820 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:25.808322 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:25.808846 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:25.808851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:25.808855 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:25.809093 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:25.809979 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:25.809987 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:25.810351 (+ 364us) client_negotiation.cc:769] Sending connection context
0809 22:53:25.810654 (+ 303us) client_negotiation.cc:240] Negotiation successful
0809 22:53:25.811329 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"thread_start_us":634,"threads_started":1}
I20260809 22:53:25.812786 15177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:25.787106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53839 (local address 127.23.131.126:39753)
0809 22:53:25.787876 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:25.787897 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:25.788691 (+ 794us) server_negotiation.cc:407] Connection header received
0809 22:53:25.792148 (+ 3457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:25.792173 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:25.792535 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:25.792866 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:25.795024 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:25.796408 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:25.798915 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:25.799706 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:25.799844 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:25.804203 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:25.804211 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:25.804227 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:25.804273 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:25.807601 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:25.808501 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:25.808509 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:25.808514 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:25.808703 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:25.809223 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:25.809228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:25.809233 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:25.809804 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:25.810023 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:25.810871 (+ 848us) server_negotiation.cc:299] Negotiation successful
0809 22:53:25.811329 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":521,"threads_started":1}
I20260809 22:53:25.816037 15174 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39753
I20260809 22:53:25.816380 15174 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:25.817189 15174 heartbeater.cc:511] Master 127.23.131.126:39753 requested a full tablet report, sending...
I20260809 22:53:25.819607 14890 ts_manager.cc:194] Registered new tserver with Master: 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65:45373)
I20260809 22:53:25.821130 14890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:53839
W20260809 22:53:26.164121 15179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:26.164479 15179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:26.164649 15179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:26.172197 15179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:26.172358 15179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:26.172552 15179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:53:26.182807 15179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:46693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=32971
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:26.184204 15179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:26.185655 15179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:26.199858 15188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:26.199802 15189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:26.199822 15191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:26.200917 15179 server_base.cc:1034] running on GCE node
I20260809 22:53:26.201633 15179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:26.202569 15179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:26.203763 15179 hybrid_clock.cc:648] HybridClock initialized: now 1786316006203701 us; error 56 us; skew 500 ppm
I20260809 22:53:26.204082 15179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:26 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316006, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:26.207301 15179 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:53:26.208747 15179 webserver.cc:460] Webserver started at http://127.23.131.66:32971/ using document root <none> and password file <none>
I20260809 22:53:26.209460 15179 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:26.209645 15179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:26.215276 15179 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:53:26.218075 15202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:26.219547 15179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:53:26.219727 15179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "61a0e8b93d97ee6386349891bee8d296"
server_key_iv: "791a1c003da600a63b066f374ab241b9"
server_key_version: "encryptionkey@0"
I20260809 22:53:26.220717 15179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:26.249095 15179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:26.253707 15179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:26.254060 15179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:26.255262 15179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:26.257071 15179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:26.257207 15179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:26.257354 15179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:26.257447 15179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:26.296991 15179 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46693
I20260809 22:53:26.297047 15376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46693 every 8 connection(s)
I20260809 22:53:26.298532 15179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:53:26.306862 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 15179
I20260809 22:53:26.307678 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:44939
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:39753
--webserver_port=42681
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:53:26 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316006, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:26.322343 15177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.301305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:37587 (local address 127.23.131.126:39753)
0809 22:53:26.301530 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.301537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.302726 (+ 1189us) server_negotiation.cc:407] Connection header received
0809 22:53:26.304669 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.304673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.304763 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.304856 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:26.306463 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.307584 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.309349 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.310181 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.310339 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.314506 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:26.314516 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:26.314524 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:26.314578 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:26.318562 (+ 3984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:26.319592 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:26.319601 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:26.319607 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:26.319796 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:26.320261 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:26.320269 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:26.320275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:26.320684 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:26.320843 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.321599 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.321882 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:53:26.323189 15380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.301809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:37587)
0809 22:53:26.302545 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.302590 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.304390 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.305099 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.305107 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.305651 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:26.306242 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.306261 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.307773 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.307778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.309175 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.309188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.310433 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.310439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.310657 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.311448 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:26.311472 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:26.314239 (+ 2767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:26.318770 (+ 4531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:26.318779 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:26.318794 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:26.319453 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:26.319915 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:26.319918 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:26.319920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:26.320142 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:26.320815 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:26.320822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:26.321195 (+ 373us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.321439 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.321869 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":287,"threads_started":1}
I20260809 22:53:26.325101 15377 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39753
I20260809 22:53:26.325446 15377 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:26.326414 15377 heartbeater.cc:511] Master 127.23.131.126:39753 requested a full tablet report, sending...
I20260809 22:53:26.328022 14890 ts_manager.cc:194] Registered new tserver with Master: bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
I20260809 22:53:26.328904 14890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:37587
W20260809 22:53:26.666337 15381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:26.666627 15381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:26.666726 15381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:26.674139 15381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:26.674258 15381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:26.674378 15381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:53:26.684547 15381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:44939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=42681
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:26.685796 15381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:26.687090 15381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:26.701355 15391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:26.701452 15396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:26.701391 15388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:26.702463 15381 server_base.cc:1034] running on GCE node
I20260809 22:53:26.703356 15381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:26.704470 15381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:26.705713 15381 hybrid_clock.cc:648] HybridClock initialized: now 1786316006705634 us; error 59 us; skew 500 ppm
I20260809 22:53:26.706148 15381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:26 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316006, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:26.709931 15381 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:53:26.711679 15381 webserver.cc:460] Webserver started at http://127.23.131.67:42681/ using document root <none> and password file <none>
I20260809 22:53:26.712416 15381 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:26.712595 15381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:26.718843 15381 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 22:53:26.721695 15406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:26.723016 15381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 22:53:26.723254 15381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "a42e645a1d69439da84af9096fe33123"
format_stamp: "Formatted at 2026-08-09 22:53:23 on dist-test-slave-92m1"
server_key: "29bea57d625b6c126aff9e5bbb7b3585"
server_key_iv: "20039a82cbf89c0da5bc12ff37316682"
server_key_version: "encryptionkey@0"
I20260809 22:53:26.724457 15381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:26.737453 15381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:26.741959 15381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:26.742264 15381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:26.743345 15381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:26.744765 15381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:26.744889 15381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:26.745041 15381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:26.745137 15381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:26.783308 15381 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:44939
I20260809 22:53:26.783357 15580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:44939 every 8 connection(s)
I20260809 22:53:26.784965 15381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:53:26.785419 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 15381
Aug 09 22:53:26 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316006, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:26.816727 15177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.787287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48950 (local address 127.23.131.126:39753)
0809 22:53:26.787560 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.787569 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.799704 (+ 12135us) server_negotiation.cc:407] Connection header received
0809 22:53:26.799934 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.799940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.800047 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.800175 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:26.802042 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.803262 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.804650 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.805329 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.805437 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.809227 (+ 3790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:26.809241 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:26.809248 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:26.809293 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:26.813482 (+ 4189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:26.814331 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:26.814337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:26.814341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:26.814504 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:26.814981 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:26.814988 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:26.814991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:26.815384 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:26.815698 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.816077 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.816320 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":87}
I20260809 22:53:26.822559 15585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.788214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:43431 (local address 127.23.131.126:39753)
0809 22:53:26.795666 (+ 7452us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.795671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.800661 (+ 4990us) server_negotiation.cc:407] Connection header received
0809 22:53:26.802970 (+ 2309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.802975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.803042 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.803147 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:26.805161 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.806338 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.808154 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.808889 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.809043 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.814434 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:26.814439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:26.814443 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:26.814514 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:26.817833 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:26.819390 (+ 1557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:26.819395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:26.819397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:26.819558 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:26.820309 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:26.820314 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:26.820316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:26.820766 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:26.820956 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.821984 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.822191 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":7328,"spinlock_wait_cycles":5376,"thread_start_us":7213,"threads_started":1}
I20260809 22:53:26.823843 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.789244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:43431)
0809 22:53:26.800472 (+ 11228us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.800525 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.802637 (+ 2112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.803532 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.803541 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.804150 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:26.804915 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.804944 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.806570 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.806575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.807981 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.807995 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.809309 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.809320 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.809674 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.810521 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:26.810560 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:26.814043 (+ 3483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:26.818022 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:26.818031 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:26.818046 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:26.819108 (+ 1062us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:26.819726 (+ 618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:26.819736 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:26.819743 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:26.820142 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:26.821049 (+ 907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:26.821058 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:26.821531 (+ 473us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.821829 (+ 298us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.822352 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10686,"thread_start_us":10367,"threads_started":1}
I20260809 22:53:26.824658 15174 heartbeater.cc:503] Master 127.23.131.126:39753 was elected leader, sending a full tablet report...
I20260809 22:53:26.827026 15581 heartbeater.cc:347] Connected to a master server at 127.23.131.126:39753
I20260809 22:53:26.827488 15581 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:26.828487 15581 heartbeater.cc:511] Master 127.23.131.126:39753 requested a full tablet report, sending...
I20260809 22:53:26.830365 14888 ts_manager.cc:194] Registered new tserver with Master: a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939)
I20260809 22:53:26.831368 14888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:43431
I20260809 22:53:26.834378 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:53:26.843031 15585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.835612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48966 (local address 127.23.131.126:39753)
0809 22:53:26.835946 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.835952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.836286 (+ 334us) server_negotiation.cc:407] Connection header received
0809 22:53:26.836495 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.836501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.836711 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.836932 (+ 221us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:53:26.837504 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.838566 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.840560 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.841101 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.841235 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.841835 (+ 600us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:53:26.842416 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:53:26.842540 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.842686 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.842774 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260809 22:53:26.844192 14888 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:48966:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:53:26.852165 14888 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:53:26.879345 15600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.865245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44939 (local address 127.0.0.1:36004)
0809 22:53:26.867433 (+ 2188us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.867451 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.867685 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.868916 (+ 1231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.868926 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.868968 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.869580 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.869596 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.872353 (+ 2757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.872362 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.875745 (+ 3383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.875768 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.878153 (+ 2385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.878159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.878384 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.878447 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.878658 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.878898 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2054,"thread_start_us":11612,"threads_started":1}
I20260809 22:53:26.879318 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.866050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36004 (local address 127.23.131.67:44939)
0809 22:53:26.866935 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.866946 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.867556 (+ 610us) server_negotiation.cc:407] Connection header received
0809 22:53:26.867908 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.867921 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.868256 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.868456 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.869868 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.872065 (+ 2197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.875997 (+ 3932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.877584 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.877708 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.877975 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.878719 (+ 744us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.878899 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":513,"threads_started":1}
I20260809 22:53:26.883497 15481 tablet_service.cc:1467] Processing CreateTablet for tablet 281625be4fae4e24a7879417c00faa00 (DEFAULT_TABLE table=test-table [id=83bc5dfbeda346689a2a7f6aeb591b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:26.885099 15481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281625be4fae4e24a7879417c00faa00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:26.886478 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.867134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48146 (local address 127.23.131.66:46693)
0809 22:53:26.876677 (+ 9543us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.876685 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.877250 (+ 565us) server_negotiation.cc:407] Connection header received
0809 22:53:26.877590 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.877599 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.877832 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.878356 (+ 524us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.879108 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.880643 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.883762 (+ 3119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.885046 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.885185 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.885394 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.885981 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.886152 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9358,"thread_start_us":9227,"threads_started":1}
I20260809 22:53:26.886536 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.866587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46693 (local address 127.0.0.1:48146)
0809 22:53:26.877145 (+ 10558us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.877164 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.877376 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.878422 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.878426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.878454 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.878883 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.878894 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.880804 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.880810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.883558 (+ 2748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.883567 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.885618 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.885625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.885789 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.885814 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.885936 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.886073 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10422,"mutex_wait_us":59,"spinlock_wait_cycles":6912,"thread_start_us":752,"threads_started":1}
I20260809 22:53:26.887465 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.865104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35098)
0809 22:53:26.866052 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.866097 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.866278 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.877118 (+ 10840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.877129 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.877156 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.877560 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.877573 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.881092 (+ 3519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.881098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.883529 (+ 2431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.883546 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.886594 (+ 3048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.886602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.886786 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.886821 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.886892 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.887016 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"mutex_wait_us":20,"thread_start_us":701,"threads_started":1}
I20260809 22:53:26.888610 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.865262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35098 (local address 127.23.131.65:45373)
0809 22:53:26.876377 (+ 11115us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.876388 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.876423 (+ 35us) server_negotiation.cc:407] Connection header received
0809 22:53:26.876550 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.876559 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.876862 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.877766 (+ 904us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.878099 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.880874 (+ 2775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.884419 (+ 3545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.886301 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.887706 (+ 1405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.887985 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.888064 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.888275 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10909,"thread_start_us":10731,"threads_started":1}
I20260809 22:53:26.891472 15274 tablet_service.cc:1467] Processing CreateTablet for tablet 281625be4fae4e24a7879417c00faa00 (DEFAULT_TABLE table=test-table [id=83bc5dfbeda346689a2a7f6aeb591b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:26.892721 15274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281625be4fae4e24a7879417c00faa00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:26.892266 15073 tablet_service.cc:1467] Processing CreateTablet for tablet 281625be4fae4e24a7879417c00faa00 (DEFAULT_TABLE table=test-table [id=83bc5dfbeda346689a2a7f6aeb591b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:26.893740 15073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281625be4fae4e24a7879417c00faa00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:26.903579 15602 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Bootstrap starting.
I20260809 22:53:26.905731 15603 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Bootstrap starting.
I20260809 22:53:26.908183 15602 tablet_bootstrap.cc:654] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:26.909432 15603 tablet_bootstrap.cc:654] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:26.909714 15604 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Bootstrap starting.
I20260809 22:53:26.910492 15602 log.cc:824] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:26.910720 15603 log.cc:824] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:26.913080 15604 tablet_bootstrap.cc:654] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:26.914000 15602 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: No bootstrap required, opened a new log
I20260809 22:53:26.913991 15603 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: No bootstrap required, opened a new log
I20260809 22:53:26.914149 15604 log.cc:824] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:26.914290 15603 ts_tablet_manager.cc:1397] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260809 22:53:26.914290 15602 ts_tablet_manager.cc:1397] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.002s
I20260809 22:53:26.917531 15604 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: No bootstrap required, opened a new log
I20260809 22:53:26.917999 15604 ts_tablet_manager.cc:1397] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260809 22:53:26.925582 15604 raft_consensus.cc:348] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.925999 15604 raft_consensus.cc:374] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:26.925698 15603 raft_consensus.cc:348] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.925697 15602 raft_consensus.cc:348] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.926100 15604 raft_consensus.cc:729] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665a3ceab2454c04b0b078a35c0e4424, State: Initialized, Role: FOLLOWER
I20260809 22:53:26.926148 15602 raft_consensus.cc:374] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:26.926147 15603 raft_consensus.cc:374] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:26.926255 15603 raft_consensus.cc:729] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd68d09e9cd54f3c8d1a66779f27f1ab, State: Initialized, Role: FOLLOWER
I20260809 22:53:26.926255 15602 raft_consensus.cc:729] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42e645a1d69439da84af9096fe33123, State: Initialized, Role: FOLLOWER
I20260809 22:53:26.926882 15604 consensus_queue.cc:260] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.926877 15602 consensus_queue.cc:260] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.926877 15603 consensus_queue.cc:260] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.930222 15604 ts_tablet_manager.cc:1428] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260809 22:53:26.932058 15377 heartbeater.cc:503] Master 127.23.131.126:39753 was elected leader, sending a full tablet report...
I20260809 22:53:26.932228 15602 ts_tablet_manager.cc:1428] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Time spent starting tablet: real 0.018s user 0.018s sys 0.001s
I20260809 22:53:26.932519 15603 ts_tablet_manager.cc:1428] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Time spent starting tablet: real 0.018s user 0.015s sys 0.004s
I20260809 22:53:26.933007 15581 heartbeater.cc:503] Master 127.23.131.126:39753 was elected leader, sending a full tablet report...
I20260809 22:53:26.937108 15608 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:26.937376 15608 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.939026 15608 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
I20260809 22:53:26.944285 15610 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:26.944551 15610 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.946231 15610 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65:45373), a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939)
I20260809 22:53:26.948917 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.940565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:36591 (local address 127.23.131.66:46693)
0809 22:53:26.940763 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.940771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.940787 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:53:26.940852 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.940858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.940929 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.941025 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.941879 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.943014 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.946239 (+ 3225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.947723 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.947861 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.947943 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.948549 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.948695 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 22:53:26.948936 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.939547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:33825 (local address 127.23.131.67:44939)
0809 22:53:26.939773 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.939781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.940788 (+ 1007us) server_negotiation.cc:407] Connection header received
0809 22:53:26.940932 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.940937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.941013 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.941098 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.941879 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.943070 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.946214 (+ 3144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.947579 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.947724 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.947809 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.948502 (+ 693us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.948641 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:53:26.949837 15616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.939967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44939 (local address 127.23.131.65:33825)
0809 22:53:26.940664 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.940682 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.940818 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.941116 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.941120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.941143 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.941703 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.941715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.943259 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.943263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.946021 (+ 2758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.946038 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.948075 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.948085 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.948291 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.948331 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.949200 (+ 869us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.949363 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":186,"thread_start_us":638,"threads_started":1}
I20260809 22:53:26.950220 15614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.939462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46693 (local address 127.23.131.65:36591)
0809 22:53:26.940164 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.940181 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.940290 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.941051 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.941054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.941102 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.941702 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.941715 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.943245 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.943254 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.946021 (+ 2767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.946037 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.948169 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.948175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.948346 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.948378 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.949209 (+ 831us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.949362 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":184,"thread_start_us":737,"threads_started":1}
I20260809 22:53:26.951042 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281625be4fae4e24a7879417c00faa00" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42e645a1d69439da84af9096fe33123" is_pre_election: true
I20260809 22:53:26.951258 15307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281625be4fae4e24a7879417c00faa00" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" is_pre_election: true
I20260809 22:53:26.951639 15511 raft_consensus.cc:2454] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 0.
I20260809 22:53:26.951795 15307 raft_consensus.cc:2454] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 0.
I20260809 22:53:26.952369 15005 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424, bd68d09e9cd54f3c8d1a66779f27f1ab; no voters:
I20260809 22:53:26.953022 15608 raft_consensus.cc:2781] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:53:26.953176 15608 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:53:26.953289 15608 raft_consensus.cc:3037] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:26.956097 15608 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.956770 15617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.946585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.23.131.66:50917)
0809 22:53:26.947317 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.947342 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.947544 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.948106 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.948110 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.948139 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.948635 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.948649 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.950398 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.950406 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.953190 (+ 2784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.953211 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.955767 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.955778 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.956003 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.956043 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.956166 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.956398 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":1922,"threads_started":1}
I20260809 22:53:26.956843 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.947052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:50917 (local address 127.23.131.65:45373)
0809 22:53:26.947274 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.947280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.947419 (+ 139us) server_negotiation.cc:407] Connection header received
0809 22:53:26.947729 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.947736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.947812 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.947876 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.948820 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.950212 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.953434 (+ 3222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.955468 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.955692 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.955812 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.956275 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.956486 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":82}
I20260809 22:53:26.957350 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281625be4fae4e24a7879417c00faa00" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42e645a1d69439da84af9096fe33123"
I20260809 22:53:26.957612 15511 raft_consensus.cc:3037] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:26.958204 15108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281625be4fae4e24a7879417c00faa00" candidate_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665a3ceab2454c04b0b078a35c0e4424" is_pre_election: true
I20260809 22:53:26.958753 15108 raft_consensus.cc:2379] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd68d09e9cd54f3c8d1a66779f27f1ab in current term 1: Already voted for candidate 665a3ceab2454c04b0b078a35c0e4424 in this term.
I20260809 22:53:26.961306 15511 raft_consensus.cc:2454] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 1.
I20260809 22:53:26.961908 15007 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424, a42e645a1d69439da84af9096fe33123; no voters:
I20260809 22:53:26.962237 15307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281625be4fae4e24a7879417c00faa00" candidate_uuid: "665a3ceab2454c04b0b078a35c0e4424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
I20260809 22:53:26.962513 15307 raft_consensus.cc:3037] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:26.964970 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.948296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:60175 (local address 127.23.131.67:44939)
0809 22:53:26.949152 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.949159 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.957421 (+ 8262us) server_negotiation.cc:407] Connection header received
0809 22:53:26.957751 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.957758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.957843 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.957907 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:26.958651 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.960048 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.962424 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.963719 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.963884 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.963973 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.964508 (+ 535us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.964656 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":1263,"threads_started":1}
I20260809 22:53:26.965272 15617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.947843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44939 (local address 127.23.131.66:60175)
0809 22:53:26.957329 (+ 9486us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:26.957351 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:26.957580 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:26.958182 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:26.958189 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:26.958220 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:26.958421 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.958433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.960236 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.960243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.962200 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:26.962243 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.963914 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.963924 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:26.964262 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.964327 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 22:53:26.964477 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 22:53:26.964708 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9380,"thread_start_us":14838,"threads_started":1}
I20260809 22:53:26.965899 15307 raft_consensus.cc:2454] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665a3ceab2454c04b0b078a35c0e4424 in term 1.
I20260809 22:53:26.966190 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281625be4fae4e24a7879417c00faa00" candidate_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42e645a1d69439da84af9096fe33123" is_pre_election: true
I20260809 22:53:26.966401 15608 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 1 election: Requested vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
I20260809 22:53:26.966521 15511 raft_consensus.cc:2379] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd68d09e9cd54f3c8d1a66779f27f1ab in current term 1: Already voted for candidate 665a3ceab2454c04b0b078a35c0e4424 in this term.
I20260809 22:53:26.966650 15608 raft_consensus.cc:2781] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:26.966805 15608 raft_consensus.cc:686] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 LEADER]: Becoming Leader. State: Replica: 665a3ceab2454c04b0b078a35c0e4424, State: Running, Role: LEADER
I20260809 22:53:26.967309 15207 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd68d09e9cd54f3c8d1a66779f27f1ab; no voters: 665a3ceab2454c04b0b078a35c0e4424, a42e645a1d69439da84af9096fe33123
I20260809 22:53:26.967432 15608 consensus_queue.cc:237] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:26.967803 15610 raft_consensus.cc:2726] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 22:53:26.972296 14888 catalog_manager.cc:5495] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65). New cstate: current_term: 1 leader_uuid: "665a3ceab2454c04b0b078a35c0e4424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } health_report { overall_health: UNKNOWN } } }
I20260809 22:53:26.991286 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:26.985276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35110 (local address 127.23.131.65:45373)
0809 22:53:26.985506 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:26.985511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:26.985585 (+ 74us) server_negotiation.cc:407] Connection header received
0809 22:53:26.985759 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:26.985763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:26.985842 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:26.985966 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:53:26.986304 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.987084 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.988766 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:26.989350 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:26.989500 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:26.990035 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:53:26.990587 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:53:26.990725 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:26.990805 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 22:53:26.990898 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260809 22:53:26.999791 15511 raft_consensus.cc:1261] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Refusing update from remote peer 665a3ceab2454c04b0b078a35c0e4424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:26.999838 15307 raft_consensus.cc:1261] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Refusing update from remote peer 665a3ceab2454c04b0b078a35c0e4424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:27.000900 15621 consensus_queue.cc:1035] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:27.001278 15608 consensus_queue.cc:1035] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:27.014560 15623 mvcc.cc:205] Tried to move back new op lower bound from 7316750364659851264 to 7316750364543299584. Current Snapshot: MvccSnapshot[applied={T|T < 7316750364659851264}]
I20260809 22:53:27.029237 14888 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:48966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:27.029564 14888 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:48966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:27.033089 14888 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Sending DeleteTablet for 3 replicas of tablet 281625be4fae4e24a7879417c00faa00
I20260809 22:53:27.034431 15481 tablet_service.cc:1514] Processing DeleteTablet for tablet 281625be4fae4e24a7879417c00faa00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:27 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:36004
I20260809 22:53:27.034473 15073 tablet_service.cc:1514] Processing DeleteTablet for tablet 281625be4fae4e24a7879417c00faa00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:27 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:35098
I20260809 22:53:27.034586 15274 tablet_service.cc:1514] Processing DeleteTablet for tablet 281625be4fae4e24a7879417c00faa00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:27 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:48146
I20260809 22:53:27.035655 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 14948
I20260809 22:53:27.062737 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.036591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35116 (local address 127.23.131.65:45373)
0809 22:53:27.036861 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:27.036871 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:27.038093 (+ 1222us) server_negotiation.cc:407] Connection header received
0809 22:53:27.038294 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:27.038303 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:27.038435 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:27.038582 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:27.040443 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:27.042002 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:27.045372 (+ 3370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:27.046337 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:27.046507 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:27.051093 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:27.051114 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:27.051141 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:27.051222 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:27.056855 (+ 5633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:27.058163 (+ 1308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:27.058178 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:27.058184 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:27.058399 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:27.058980 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:27.058988 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:27.058994 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:27.059671 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:27.060109 (+ 438us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:27.061856 (+ 1747us) server_negotiation.cc:299] Negotiation successful
0809 22:53:27.062211 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 22:53:27.065279 15168 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:27.066197 15641 tablet_replica.cc:330] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: stopping tablet replica
I20260809 22:53:27.066594 15642 tablet_replica.cc:330] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: stopping tablet replica
I20260809 22:53:27.066884 15641 raft_consensus.cc:2229] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:27.066988 15642 raft_consensus.cc:2229] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:27.067581 15642 raft_consensus.cc:2258] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:27.067570 15641 raft_consensus.cc:2258] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:27.069942 15641 ts_tablet_manager.cc:1905] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:27.069942 15642 ts_tablet_manager.cc:1905] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:27.077325 15642 ts_tablet_manager.cc:1918] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:27.077325 15641 ts_tablet_manager.cc:1918] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:27.077512 15642 log.cc:1196] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/281625be4fae4e24a7879417c00faa00
I20260809 22:53:27.077520 15641 log.cc:1196] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/281625be4fae4e24a7879417c00faa00
I20260809 22:53:27.078126 15642 ts_tablet_manager.cc:1939] T 281625be4fae4e24a7879417c00faa00 P bd68d09e9cd54f3c8d1a66779f27f1ab: Deleting consensus metadata
I20260809 22:53:27.078128 15641 ts_tablet_manager.cc:1939] T 281625be4fae4e24a7879417c00faa00 P a42e645a1d69439da84af9096fe33123: Deleting consensus metadata
I20260809 22:53:27.080221 14871 catalog_manager.cc:4841] TS a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): tablet 281625be4fae4e24a7879417c00faa00 (table test-table [id=83bc5dfbeda346689a2a7f6aeb591b2e]) successfully deleted
I20260809 22:53:27.080199 14869 catalog_manager.cc:4841] TS bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): tablet 281625be4fae4e24a7879417c00faa00 (table test-table [id=83bc5dfbeda346689a2a7f6aeb591b2e]) successfully deleted
I20260809 22:53:27.173077 15639 tablet_replica.cc:330] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: stopping tablet replica
I20260809 22:53:27.173584 15639 raft_consensus.cc:2229] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:53:27.174252 15639 raft_consensus.cc:2258] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:27.175304 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 14948
W20260809 22:53:27.203308 14869 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:45373 (error 108)
I20260809 22:53:27.203517 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 15179
I20260809 22:53:27.205447 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.204926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35128)
0809 22:53:27.205133 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.205262 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 22:53:27.205713 14869 catalog_manager.cc:4584] TS 665a3ceab2454c04b0b078a35c0e4424 (127.23.131.65:45373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 281625be4fae4e24a7879417c00faa00: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
I20260809 22:53:27.217826 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.204311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.23.131.66:46693)
0809 22:53:27.204505 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:27.204510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:27.204634 (+ 124us) server_negotiation.cc:407] Connection header received
0809 22:53:27.204856 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:27.204865 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:27.204948 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:27.205092 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:27.206696 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:27.207528 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:27.208929 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:27.209325 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:27.209415 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:27.212228 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:27.212244 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:27.212259 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:27.212310 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:27.215164 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:27.215888 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:27.215895 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:27.215897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:27.216047 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:27.216369 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:27.216372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:27.216374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:27.216755 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:27.216970 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:27.217251 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 22:53:27.217419 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:53:27.218551 15370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:27.259641 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.259097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35142)
0809 22:53:27.259353 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.259463 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 22:53:27.260691 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.260331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35146)
0809 22:53:27.260493 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.260591 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 22:53:27.313148 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 15179
I20260809 22:53:27.322882 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.322408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35150)
0809 22:53:27.322614 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.322712 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 22:53:27.324034 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.323724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35154)
0809 22:53:27.323863 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.323933 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 22:53:27.343251 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 15381
I20260809 22:53:27.357198 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.344141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36020 (local address 127.23.131.67:44939)
0809 22:53:27.344320 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:27.344325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:27.344343 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:53:27.344451 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:27.344454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:27.344538 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:27.344626 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:27.346009 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:27.346679 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:27.348427 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:27.348837 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:27.348935 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:27.351619 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:27.351631 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:27.351646 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:27.351675 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:27.354332 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:27.355077 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:27.355084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:27.355086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:27.355224 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:27.355711 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:27.355718 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:27.355721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:27.356135 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:27.356358 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:27.356724 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 22:53:27.356946 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 22:53:27.357882 15572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:27.405484 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.404879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35166)
0809 22:53:27.405127 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.405257 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 22:53:27.406695 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.406231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35172)
0809 22:53:27.406465 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.406553 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260809 22:53:27.452522 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 15381
I20260809 22:53:27.482810 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 14834
I20260809 22:53:27.484170 14936 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:27.608929 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 14834
I20260809 22:53:27.609014 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:27.608041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:45373 (local address 127.0.0.1:35180)
0809 22:53:27.608431 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:27.608777 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:45373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222}
I20260809 22:53:27.642342 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39753
--webserver_interface=127.23.131.126
--webserver_port=42369
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:28.001685 15653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:28.002017 15653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:28.002199 15653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:28.009824 15653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:28.009954 15653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:28.010074 15653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:28.010191 15653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:28.010257 15653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:28.020598 15653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=42369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:28.022009 15653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:28.023380 15653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:28.035284 15659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:28.035358 15661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:28.035382 15658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:28.036790 15653 server_base.cc:1034] running on GCE node
I20260809 22:53:28.037698 15653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:28.039125 15653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:28.040383 15653 hybrid_clock.cc:648] HybridClock initialized: now 1786316008040315 us; error 58 us; skew 500 ppm
I20260809 22:53:28.040756 15653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:28 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316008, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:28.044013 15653 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:28.045629 15653 webserver.cc:460] Webserver started at http://127.23.131.126:42369/ using document root <none> and password file <none>
I20260809 22:53:28.046355 15653 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:28.046510 15653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:28.052260 15653 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 22:53:28.055258 15675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:28.056618 15653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:53:28.056815 15653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "b91dd443eef949c09a36c5715dc0f5eb"
format_stamp: "Formatted at 2026-08-09 22:53:21 on dist-test-slave-92m1"
server_key: "bed7805c63140bc5dd461222d9cfb3c7"
server_key_iv: "96a1daec08d996ca57eea4cb05527d00"
server_key_version: "encryptionkey@0"
I20260809 22:53:28.057847 15653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:28.080631 15653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:28.084816 15653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:28.085103 15653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:28.105211 15653 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:39753
I20260809 22:53:28.105268 15758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:39753 every 8 connection(s)
I20260809 22:53:28.106788 15653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:28.108085 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 15653
I20260809 22:53:28.109193 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:45373
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:39753
--webserver_port=34629
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:28.117266 15759 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:53:28.122570 15759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap starting.
I20260809 22:53:28.146418 15759 log.cc:824] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:28.164979 15759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:53:28.165596 15759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb: Bootstrap complete.
I20260809 22:53:28.175086 15759 raft_consensus.cc:348] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:28.176121 15759 raft_consensus.cc:729] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91dd443eef949c09a36c5715dc0f5eb, State: Initialized, Role: FOLLOWER
I20260809 22:53:28.176721 15759 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:28.176971 15759 raft_consensus.cc:388] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:28.177124 15759 raft_consensus.cc:482] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:28.177312 15759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 2 FOLLOWER]: Advancing to term 3
I20260809 22:53:28.181380 15759 raft_consensus.cc:504] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:28.181888 15759 leader_election.cc:302] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b91dd443eef949c09a36c5715dc0f5eb; no voters:
I20260809 22:53:28.182608 15759 leader_election.cc:288] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 22:53:28.182781 15764 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 3 FOLLOWER]: Leader election won for term 3
I20260809 22:53:28.184048 15764 raft_consensus.cc:686] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [term 3 LEADER]: Becoming Leader. State: Replica: b91dd443eef949c09a36c5715dc0f5eb, State: Running, Role: LEADER
I20260809 22:53:28.184708 15764 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } }
I20260809 22:53:28.184937 15759 sys_catalog.cc:564] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:28.187557 15767 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91dd443eef949c09a36c5715dc0f5eb. Latest consensus state: current_term: 3 leader_uuid: "b91dd443eef949c09a36c5715dc0f5eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } } }
I20260809 22:53:28.188467 15767 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:28.188961 15765 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b91dd443eef949c09a36c5715dc0f5eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91dd443eef949c09a36c5715dc0f5eb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39753 } } }
I20260809 22:53:28.189684 15765 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91dd443eef949c09a36c5715dc0f5eb [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:28.196630 15772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:28.207831 15772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:28.209961 15772 catalog_manager.cc:1259] Loaded cluster ID: 9ee1409531e044bd8aa03f534992b2dc
I20260809 22:53:28.210151 15772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 22:53:28.213073 15772 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f7067d079ad google::LogMessage::Fail() at ??:0
@ 0x7f7067d0a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f7067d074de google::LogMessage::Flush() at ??:0
@ 0x7f7067d08a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f707d740512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f707d73d976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
I20260809 22:53:28.239142 15787 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f707d7c5610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f707d7c5439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f706a953345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f706a95691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f706a956799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f706a931eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f706dc0b6db start_thread at ??:0
@ 0x7f7066ba161f clone at ??:0
W20260809 22:53:28.541687 15762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:28.541992 15762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:28.542167 15762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:28.549649 15762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:28.549774 15762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:28.550031 15762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:53:28.560207 15762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:45373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=34629
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:28.561640 15762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:28.563032 15762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:28.577215 15810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:28.577251 15812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:28.577296 15815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:28.578626 15762 server_base.cc:1034] running on GCE node
I20260809 22:53:28.579425 15762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:28.580624 15762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:28.581866 15762 hybrid_clock.cc:648] HybridClock initialized: now 1786316008581814 us; error 52 us; skew 500 ppm
I20260809 22:53:28.582223 15762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:28 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316008, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:28.585813 15762 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:53:28.587522 15762 webserver.cc:460] Webserver started at http://127.23.131.65:34629/ using document root <none> and password file <none>
I20260809 22:53:28.588301 15762 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:28.588454 15762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:28.594512 15762 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 22:53:28.597628 15827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:28.598968 15762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:53:28.599167 15762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "665a3ceab2454c04b0b078a35c0e4424"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "f6e8761dc2e734eb453513cedc730f32"
server_key_iv: "b36389b6886112b2a7fb5a777f550848"
server_key_version: "encryptionkey@0"
I20260809 22:53:28.600261 15762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:28.616436 15762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:28.621224 15762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:28.621587 15762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:28.622743 15762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:28.624823 15841 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 22:53:28.630666 15762 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 22:53:28.630861 15762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260809 22:53:28.631078 15762 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 22:53:28.634609 15762 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 22:53:28.634749 15762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260809 22:53:28.635270 15841 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Bootstrap starting.
I20260809 22:53:28.644712 15841 log.cc:824] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:28.663147 15841 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:53:28.664145 15841 tablet_bootstrap.cc:492] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Bootstrap complete.
I20260809 22:53:28.664789 15841 ts_tablet_manager.cc:1397] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.006s
I20260809 22:53:28.679216 15841 raft_consensus.cc:348] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:28.681429 15841 raft_consensus.cc:729] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665a3ceab2454c04b0b078a35c0e4424, State: Initialized, Role: FOLLOWER
I20260809 22:53:28.682633 15841 consensus_queue.cc:260] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:28.685407 15841 ts_tablet_manager.cc:1428] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424: Time spent starting tablet: real 0.020s user 0.017s sys 0.003s
I20260809 22:53:28.690900 15762 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:45373
I20260809 22:53:28.690992 16005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:45373 every 8 connection(s)
I20260809 22:53:28.692253 15762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:53:28.693128 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 15762
I20260809 22:53:28.693974 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:46693
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:39753
--webserver_port=32971
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:53:28.697687 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:28.695673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:43367)
0809 22:53:28.696575 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:28.696822 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":399,"threads_started":1}
W20260809 22:53:28.698374 16007 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:39753 (0 consecutive failures): Network error: Failed to ping master at 127.23.131.126:39753: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
I20260809 22:53:28.699419 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:28.698996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:36063)
0809 22:53:28.699169 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:28.699309 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 22:53:28.700335 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:28.699963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:39075)
0809 22:53:28.700142 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:28.700213 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 22:53:28.700603 16007 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 22:53:29.054764 16010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:29.055053 16010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:29.055151 16010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:29.062579 16010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:29.062685 16010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:29.062857 16010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:53:29.072840 16010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:46693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=32971
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:29.074226 16010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:29.075675 16010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:29.089468 16018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:29.089423 16023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:29.089385 16021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:29.090791 16010 server_base.cc:1034] running on GCE node
I20260809 22:53:29.091609 16010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:29.092653 16010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:29.093883 16010 hybrid_clock.cc:648] HybridClock initialized: now 1786316009093825 us; error 49 us; skew 500 ppm
I20260809 22:53:29.094221 16010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:29 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316009, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:29.097681 16010 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:53:29.099280 16010 webserver.cc:460] Webserver started at http://127.23.131.66:32971/ using document root <none> and password file <none>
I20260809 22:53:29.099973 16010 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:29.100096 16010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:29.105660 16010 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 22:53:29.108438 16033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:29.109836 16010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:53:29.110028 16010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab"
format_stamp: "Formatted at 2026-08-09 22:53:22 on dist-test-slave-92m1"
server_key: "61a0e8b93d97ee6386349891bee8d296"
server_key_iv: "791a1c003da600a63b066f374ab241b9"
server_key_version: "encryptionkey@0"
I20260809 22:53:29.111048 16010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:29.135162 16010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:29.140110 16010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:29.140407 16010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:29.141482 16010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:29.142925 16010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:29.143064 16010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:29.143242 16010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:29.143347 16010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 22:53:29.178488 16010 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46693
I20260809 22:53:29.178587 16207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46693 every 8 connection(s)
I20260809 22:53:29.180071 16010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:53:29.185084 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.183158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:48761)
0809 22:53:29.183989 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.184234 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":312,"threads_started":1}
W20260809 22:53:29.185731 16208 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:39753 (0 consecutive failures): Network error: Failed to ping master at 127.23.131.126:39753: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
I20260809 22:53:29.186715 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.186346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:59627)
0809 22:53:29.186498 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.186586 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 22:53:29.187692 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.187358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:34887)
0809 22:53:29.187494 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.187587 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 22:53:29.187935 16208 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 22:53:29.190012 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 16010
I20260809 22:53:29.190685 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:44939
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:39753
--webserver_port=42681
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:36421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:29.565745 16212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:29.566069 16212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:29.566234 16212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:29.574170 16212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:29.574296 16212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:29.574473 16212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:53:29.584939 16212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:36421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:44939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=42681
--tserver_master_addrs=127.23.131.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:29.586400 16212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:29.587903 16212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:29.602156 16226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:29.602155 16227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:29.602174 16230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:29.603802 16212 server_base.cc:1034] running on GCE node
I20260809 22:53:29.604486 16212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:29.605569 16212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:29.606805 16212 hybrid_clock.cc:648] HybridClock initialized: now 1786316009606752 us; error 66 us; skew 500 ppm
I20260809 22:53:29.607154 16212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:29 dist-test-slave-92m1 krb5kdc[13996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316009, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:29.613467 16212 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:53:29.615161 16212 webserver.cc:460] Webserver started at http://127.23.131.67:42681/ using document root <none> and password file <none>
I20260809 22:53:29.616015 16212 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:29.616168 16212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:29.621731 16212 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 22:53:29.624607 16244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:29.626070 16212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:53:29.626247 16212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "a42e645a1d69439da84af9096fe33123"
format_stamp: "Formatted at 2026-08-09 22:53:23 on dist-test-slave-92m1"
server_key: "29bea57d625b6c126aff9e5bbb7b3585"
server_key_iv: "20039a82cbf89c0da5bc12ff37316682"
server_key_version: "encryptionkey@0"
I20260809 22:53:29.627285 16212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:29.642694 16212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:29.647122 16212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:29.647459 16212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:29.648505 16212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:29.649928 16212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:29.650065 16212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:29.650205 16212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:29.650295 16212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:29.687062 16212 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:44939
I20260809 22:53:29.687104 16413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:44939 every 8 connection(s)
I20260809 22:53:29.688721 16212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:53:29.694816 16421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.692553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:46983)
0809 22:53:29.693435 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.693714 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":333,"threads_started":1}
W20260809 22:53:29.695480 16415 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:39753 (0 consecutive failures): Network error: Failed to ping master at 127.23.131.126:39753: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
I20260809 22:53:29.696501 16421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.696072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:37643)
0809 22:53:29.696271 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.696364 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 22:53:29.697372 16421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.696996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:60185)
0809 22:53:29.697144 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.697236 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 22:53:29.697574 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 16212
W20260809 22:53:29.697715 16415 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 22:53:29.701761 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.701072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:52619)
0809 22:53:29.701472 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.701555 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":186,"threads_started":1}
I20260809 22:53:29.835778 16425 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:29.836174 16425 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:29.837850 16425 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
Aug 09 22:53:29 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316008, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
Aug 09 22:53:29 dist-test-slave-92m1 krb5kdc[13996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316008, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:53:29.869149 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.838372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46693 (local address 127.23.131.65:57573)
0809 22:53:29.838808 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.838862 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:29.839598 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:29.844458 (+ 4860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:29.844472 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:29.845614 (+ 1142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:29.847151 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:29.847187 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.849758 (+ 2571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.849766 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:29.852701 (+ 2935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:29.852721 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.854265 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.854273 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:29.854647 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:29.855786 (+ 1139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:29.855838 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:29.859677 (+ 3839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:29.864095 (+ 4418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:29.864107 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:29.864126 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:29.865209 (+ 1083us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:29.865794 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:29.865800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:29.865804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:29.866131 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:29.867166 (+ 1035us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:29.867174 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:29.867669 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 22:53:29.868012 (+ 343us) client_negotiation.cc:240] Negotiation successful
0809 22:53:29.868760 (+ 748us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":719,"spinlock_wait_cycles":74112}
I20260809 22:53:29.869202 16429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.838599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:47235 (local address 127.23.131.67:44939)
0809 22:53:29.840866 (+ 2267us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:29.840881 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:29.840925 (+ 44us) server_negotiation.cc:407] Connection header received
0809 22:53:29.843316 (+ 2391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:29.843329 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:29.843832 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:29.844210 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:29.847522 (+ 3312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.849496 (+ 1974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.852879 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.853904 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.854128 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:29.859652 (+ 5524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:29.859659 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:29.859675 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:29.859719 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:29.863909 (+ 4190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:29.865386 (+ 1477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:29.865395 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:29.865403 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:29.865625 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:29.866270 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:29.866275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:29.866279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:29.866976 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:29.867190 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:29.868300 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0809 22:53:29.868773 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2048,"thread_start_us":1865,"threads_started":1}
I20260809 22:53:29.869407 16428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.838558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:57573 (local address 127.23.131.66:46693)
0809 22:53:29.841125 (+ 2567us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:29.841138 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:29.841172 (+ 34us) server_negotiation.cc:407] Connection header received
0809 22:53:29.843315 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:29.843329 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:29.843832 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:29.844210 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:29.847525 (+ 3315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.849484 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.852879 (+ 3395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.853904 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.854109 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:29.859982 (+ 5873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:29.859992 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:29.860007 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:29.860060 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:29.863909 (+ 3849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:29.865389 (+ 1480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:29.865395 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:29.865403 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:29.865625 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:29.866270 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:29.866275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:29.866279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:29.867010 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:29.867190 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:29.868574 (+ 1384us) server_negotiation.cc:299] Negotiation successful
0809 22:53:29.868981 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2398,"thread_start_us":2213,"threads_started":1}
I20260809 22:53:29.869158 16426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:29.838412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:44939 (local address 127.23.131.65:47235)
0809 22:53:29.840455 (+ 2043us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:29.840477 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:29.840597 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:29.844458 (+ 3861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:29.844472 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:29.845614 (+ 1142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:29.847151 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:29.847187 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.849762 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.849767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:29.852701 (+ 2934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:29.852721 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:29.854231 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:29.854242 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:29.854650 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:29.855786 (+ 1136us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:29.855834 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:29.859333 (+ 3499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:29.864095 (+ 4762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:29.864107 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:29.864126 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:29.865209 (+ 1083us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:29.865794 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:29.865800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:29.865803 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:29.866131 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:29.867166 (+ 1035us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:29.867174 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:29.867669 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 22:53:29.868012 (+ 343us) client_negotiation.cc:240] Negotiation successful
0809 22:53:29.868629 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1885,"mutex_wait_us":677,"spinlock_wait_cycles":51584,"thread_start_us":1712,"threads_started":1}
W20260809 22:53:29.873270 15831 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
W20260809 22:53:29.873651 15835 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
I20260809 22:53:29.873829 15835 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424; no voters: a42e645a1d69439da84af9096fe33123, bd68d09e9cd54f3c8d1a66779f27f1ab
I20260809 22:53:29.874246 16425 raft_consensus.cc:2726] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 22:53:30.189646 16431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:30.188554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:41011)
0809 22:53:30.189087 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:30.189347 (+ 260us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":242,"threads_started":1}
I20260809 22:53:30.699133 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:30.698298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:37481)
0809 22:53:30.698771 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:30.698895 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":223,"threads_started":1}
I20260809 22:53:30.703596 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:30.702709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:35911)
0809 22:53:30.703306 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:30.703421 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":295,"threads_started":1}
I20260809 22:53:31.191519 16437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:31.190559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:52719)
0809 22:53:31.191099 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:31.191181 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":342,"threads_started":1}
I20260809 22:53:31.519163 16438 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:31.519419 16438 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:31.520074 16438 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
W20260809 22:53:31.521107 15835 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
W20260809 22:53:31.521281 15831 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
I20260809 22:53:31.521458 15831 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424; no voters: a42e645a1d69439da84af9096fe33123, bd68d09e9cd54f3c8d1a66779f27f1ab
I20260809 22:53:31.521749 16438 raft_consensus.cc:2726] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 22:53:31.700990 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:31.700199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:41991)
0809 22:53:31.700692 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:31.700784 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":237,"threads_started":1}
I20260809 22:53:31.705605 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:31.704627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:58975)
0809 22:53:31.705229 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:31.705387 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":315,"threads_started":1}
I20260809 22:53:32.194401 16443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:32.192937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:55283)
0809 22:53:32.193865 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:32.194035 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":493,"threads_started":1}
I20260809 22:53:32.703188 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:32.702093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:56501)
0809 22:53:32.702756 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:32.702903 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":341,"threads_started":1}
I20260809 22:53:32.707558 16445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:32.706551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:51943)
0809 22:53:32.707120 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:32.707320 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":319,"threads_started":1}
I20260809 22:53:33.197479 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:33.196013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:60001)
0809 22:53:33.196939 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:33.197085 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":600,"threads_started":1}
I20260809 22:53:33.209511 16450 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:33.209781 16450 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:33.210803 16450 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
W20260809 22:53:33.212445 15831 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
W20260809 22:53:33.212733 15835 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
I20260809 22:53:33.212937 15835 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424; no voters: a42e645a1d69439da84af9096fe33123, bd68d09e9cd54f3c8d1a66779f27f1ab
I20260809 22:53:33.213308 16450 raft_consensus.cc:2726] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 22:53:33.705192 16451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:33.704310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:54939)
0809 22:53:33.704864 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:33.704978 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":239,"threads_started":1}
I20260809 22:53:33.709549 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:33.708694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:37657)
0809 22:53:33.709258 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:33.709348 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":280,"threads_started":1}
I20260809 22:53:34.199501 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:34.198627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:55803)
0809 22:53:34.199144 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:34.199314 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":301,"threads_started":1}
I20260809 22:53:34.706863 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:34.706135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:32781)
0809 22:53:34.706555 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:34.706706 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":226,"threads_started":1}
I20260809 22:53:34.711191 16456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:34.710478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:47393)
0809 22:53:34.710915 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:34.711010 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":224,"threads_started":1}
I20260809 22:53:35.201229 16457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:35.200378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:41219)
0809 22:53:35.200906 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:35.200989 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":267,"threads_started":1}
I20260809 22:53:35.708457 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:35.707758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:60939)
0809 22:53:35.708201 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:35.708283 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":225,"threads_started":1}
I20260809 22:53:35.712882 16459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:35.712105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:36823)
0809 22:53:35.712599 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:35.712695 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":277,"threads_started":1}
I20260809 22:53:36.185249 16460 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:36.185503 16460 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:36.186625 16460 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
W20260809 22:53:36.187417 15831 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
W20260809 22:53:36.187594 15835 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
I20260809 22:53:36.187731 15835 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424; no voters: a42e645a1d69439da84af9096fe33123, bd68d09e9cd54f3c8d1a66779f27f1ab
I20260809 22:53:36.188011 16460 raft_consensus.cc:2726] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 22:53:36.203374 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:36.202228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:45173)
0809 22:53:36.202912 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:36.203082 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":304,"threads_started":1}
I20260809 22:53:36.710260 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:36.709436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:35805)
0809 22:53:36.709966 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:36.710051 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":235,"threads_started":1}
I20260809 22:53:36.714625 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:36.713758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:38069)
0809 22:53:36.714273 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:36.714385 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":282,"threads_started":1}
I20260809 22:53:37.205236 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:37.204393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:43445)
0809 22:53:37.204895 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:37.205014 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":214,"threads_started":1}
I20260809 22:53:37.712122 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:37.711380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:44779)
0809 22:53:37.711827 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:37.711928 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":227,"threads_started":1}
I20260809 22:53:37.716665 16466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:37.715735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:49117)
0809 22:53:37.716340 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:37.716431 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":337,"threads_started":1}
I20260809 22:53:38.207137 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:38.206245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:48965)
0809 22:53:38.206825 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:38.206935 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":295,"threads_started":1}
I20260809 22:53:38.713850 16468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:38.713133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:52897)
0809 22:53:38.713592 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:38.713685 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":223,"threads_started":1}
I20260809 22:53:38.718412 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:38.717728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:44459)
0809 22:53:38.718176 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:38.718257 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":228,"threads_started":1}
I20260809 22:53:39.208897 16470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:39.208159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:56243)
0809 22:53:39.208619 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:39.208706 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":252,"threads_started":1}
I20260809 22:53:39.715590 16471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:39.714840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:40807)
0809 22:53:39.715321 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:39.715404 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":247,"threads_started":1}
I20260809 22:53:39.720273 16472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:39.719466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:35879)
0809 22:53:39.719993 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:39.720076 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":305,"threads_started":1}
I20260809 22:53:40.210758 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:40.209922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:50725)
0809 22:53:40.210474 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:40.210583 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":281,"threads_started":1}
I20260809 22:53:40.717360 16476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:40.716544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:54501)
0809 22:53:40.717090 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:40.717179 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":268,"threads_started":1}
I20260809 22:53:40.722333 16478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:40.721334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:47809)
0809 22:53:40.721968 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:40.722115 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":364,"threads_started":1}
I20260809 22:53:41.212481 16480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:41.211755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:33051)
0809 22:53:41.212224 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:41.212301 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":254,"threads_started":1}
I20260809 22:53:41.719058 16481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:41.718323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:55675)
0809 22:53:41.718804 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:41.718887 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":253,"threads_started":1}
I20260809 22:53:41.724102 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:41.723284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:58929)
0809 22:53:41.723846 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:41.723937 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":321,"threads_started":1}
I20260809 22:53:42.214365 16483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:42.213505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:37827)
0809 22:53:42.214066 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:42.214183 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":272,"threads_started":1}
I20260809 22:53:42.720857 16484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:42.720031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:60169)
0809 22:53:42.720545 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:42.720681 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":256,"threads_started":1}
I20260809 22:53:42.725924 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:42.725060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:57791)
0809 22:53:42.725640 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:42.725726 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":306,"threads_started":1}
I20260809 22:53:43.171977 16488 raft_consensus.cc:482] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:43.172634 16488 raft_consensus.cc:504] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "665a3ceab2454c04b0b078a35c0e4424" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 45373 } } peers { permanent_uuid: "a42e645a1d69439da84af9096fe33123" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 44939 } } peers { permanent_uuid: "bd68d09e9cd54f3c8d1a66779f27f1ab" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46693 } }
I20260809 22:53:43.173629 16488 leader_election.cc:288] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939), bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693)
W20260809 22:53:43.175012 15835 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a42e645a1d69439da84af9096fe33123 (127.23.131.67:44939): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
W20260809 22:53:43.176863 15831 leader_election.cc:341] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bd68d09e9cd54f3c8d1a66779f27f1ab (127.23.131.66:46693): Not found: Tablet not found: 281625be4fae4e24a7879417c00faa00
I20260809 22:53:43.177032 15831 leader_election.cc:302] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665a3ceab2454c04b0b078a35c0e4424; no voters: a42e645a1d69439da84af9096fe33123, bd68d09e9cd54f3c8d1a66779f27f1ab
I20260809 22:53:43.177320 16488 raft_consensus.cc:2726] T 281625be4fae4e24a7879417c00faa00 P 665a3ceab2454c04b0b078a35c0e4424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 22:53:43.216303 16489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:43.215377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:33927)
0809 22:53:43.215980 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:43.216086 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":337,"threads_started":1}
I20260809 22:53:43.723114 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:43.722217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:52371)
0809 22:53:43.722717 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:43.722815 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":263,"threads_started":1}
I20260809 22:53:43.728142 16492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:43.727296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:44213)
0809 22:53:43.727849 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:43.727969 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":231,"threads_started":1}
I20260809 22:53:44.218189 16493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:44.217463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.66:46421)
0809 22:53:44.217914 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:44.218024 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":226,"threads_started":1}
I20260809 22:53:44.707967 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 15762
I20260809 22:53:44.725272 16497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:44.724421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.67:35241)
0809 22:53:44.724981 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:44.725089 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":297,"threads_started":1}
I20260809 22:53:44.729990 16496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:44.709121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58018 (local address 127.23.131.65:45373)
0809 22:53:44.709775 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:44.709784 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:44.709818 (+ 34us) server_negotiation.cc:407] Connection header received
0809 22:53:44.709902 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:44.709911 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:44.710230 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:44.710378 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:44.712495 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:44.713547 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:44.714820 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:44.715494 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:44.715628 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:44.723412 (+ 7784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:44.723440 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:44.723457 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:44.723503 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:44.726838 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:44.727666 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:44.727673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:44.727676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:44.727830 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:44.728187 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:44.728190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:44.728192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:44.728582 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:44.728920 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:44.729284 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 22:53:44.729639 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":488,"threads_started":1}
I20260809 22:53:44.730130 16498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:44.729007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:39753 (local address 127.23.131.65:43547)
0809 22:53:44.729623 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:44.729817 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:39753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":305,"threads_started":1}
I20260809 22:53:44.731498 16001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:44.824524 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 15762
I20260809 22:53:44.856971 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 16010
I20260809 22:53:44.870813 16500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:44.857795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49940 (local address 127.23.131.66:46693)
0809 22:53:44.858360 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:44.858365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:44.858380 (+ 15us) server_negotiation.cc:407] Connection header received
0809 22:53:44.858439 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:44.858443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:44.858504 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:44.858605 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:44.860019 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:44.860838 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:44.862066 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:44.862480 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:44.862573 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:44.865240 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:44.865245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:44.865248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:44.865279 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:44.868030 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:44.868741 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:44.868748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:44.868751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:44.868893 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:44.869296 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:44.869301 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:44.869304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:44.869570 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:44.869871 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:44.870170 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 22:53:44.870416 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":317,"threads_started":1}
I20260809 22:53:44.871820 16202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:44.959358 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 16010
I20260809 22:53:44.988989 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 16212
I20260809 22:53:45.004117 16504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:44.989892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36190 (local address 127.23.131.67:44939)
0809 22:53:44.990510 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:44.990514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:44.990531 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:53:44.990585 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:44.990589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:44.990670 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:44.990800 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:44.992479 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:44.993304 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:44.994760 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:44.995322 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:44.995463 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:44.998277 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:44.998283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:44.998287 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:44.998321 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:45.001137 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:45.001888 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:45.001894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:45.001898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:45.002042 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:45.002460 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:45.002466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:45.002469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:45.002760 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:45.003091 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:45.003448 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 22:53:45.003701 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":308,"threads_started":1}
I20260809 22:53:45.004870 16407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:45.092844 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 16212
2026-08-09T22:53:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25516 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:53:45 dist-test-slave-92m1 krb5kdc[16510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:53:45 dist-test-slave-92m1 krb5kdc[16510](info): set up 2 sockets
Aug 09 22:53:45 dist-test-slave-92m1 krb5kdc[16510](info): commencing operation
krb5kdc: starting...
W20260809 22:53:46.528997 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.385s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:53:46 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:53:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:53:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:53:46.904491 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44949
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:47.270810 16533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:47.271116 16533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:47.271230 16533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:47.278872 16533 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 22:53:47.278981 16533 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 22:53:47.279022 16533 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 22:53:47.279078 16533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:53:47.279136 16533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:47.279222 16533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:47.279330 16533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:53:47.279436 16533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:53:47.289624 16533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:47.290889 16533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:47.292282 16533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:47.304754 16542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:47.304981 16540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:47.305253 16545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:47.305527 16533 server_base.cc:1034] running on GCE node
I20260809 22:53:47.306401 16533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:47.307912 16533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:47.309168 16533 hybrid_clock.cc:648] HybridClock initialized: now 1786316027309101 us; error 42 us; skew 500 ppm
I20260809 22:53:47.309525 16533 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:47 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316027, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:47.312822 16533 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:53:47.314364 16533 webserver.cc:460] Webserver started at http://127.23.131.126:41289/ using document root <none> and password file <none>
I20260809 22:53:47.315112 16533 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:47.315272 16533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:47.315619 16533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:47.319382 16533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "96977594b5bc4b50baeaa32d228f4893"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "90fca20de28d19363d9d5139530e08b0"
server_key_iv: "89e5745c7c95378901b5fbbe857e1345"
server_key_version: "encryptionkey@0"
I20260809 22:53:47.320235 16533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "96977594b5bc4b50baeaa32d228f4893"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "90fca20de28d19363d9d5139530e08b0"
server_key_iv: "89e5745c7c95378901b5fbbe857e1345"
server_key_version: "encryptionkey@0"
I20260809 22:53:47.325752 16533 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 22:53:47.329592 16556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:47.331168 16533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:53:47.331456 16533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "96977594b5bc4b50baeaa32d228f4893"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "90fca20de28d19363d9d5139530e08b0"
server_key_iv: "89e5745c7c95378901b5fbbe857e1345"
server_key_version: "encryptionkey@0"
I20260809 22:53:47.331693 16533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:47.345948 16533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:47.351624 16533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:47.351961 16533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:47.372771 16533 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:44949
I20260809 22:53:47.372797 16625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:44949 every 8 connection(s)
I20260809 22:53:47.374240 16533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:53:47.378131 16626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:47.381667 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 16533
I20260809 22:53:47.381918 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:53:47.382618 24077 external_mini_cluster.cc:1428] Setting key bad68827c8a7331c17b77b137924229a
I20260809 22:53:47.391460 16626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap starting.
I20260809 22:53:47.395355 16626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:47.396724 16626 log.cc:824] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:53:47 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:47.399705 16626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: No bootstrap required, opened a new log
I20260809 22:53:47.406764 16631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:47.384680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56328 (local address 127.23.131.126:44949)
0809 22:53:47.385497 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:47.385508 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:47.385549 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:53:47.387164 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:47.387186 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:47.387627 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:47.387938 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:47.389867 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:47.391145 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:47.393104 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:47.393984 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:47.394122 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:47.399188 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:47.399196 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:47.399267 (+ 71us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:47.399310 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:47.402540 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:47.403334 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:47.403346 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:47.403352 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:47.403522 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:47.403939 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:47.403943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:47.403948 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:47.404505 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:47.404844 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:47.405312 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 22:53:47.405746 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":404,"threads_started":1}
I20260809 22:53:47.407809 16626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:53:47.408258 16626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:47.408378 16626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96977594b5bc4b50baeaa32d228f4893, State: Initialized, Role: FOLLOWER
I20260809 22:53:47.409041 16626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:53:47.409366 16626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:53:47.409524 16626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:53:47.409727 16626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:47.412192 16626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:53:47.412720 16626 leader_election.cc:302] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96977594b5bc4b50baeaa32d228f4893; no voters:
I20260809 22:53:47.413378 16626 leader_election.cc:288] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:53:47.413545 16634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:47.414273 16634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 LEADER]: Becoming Leader. State: Replica: 96977594b5bc4b50baeaa32d228f4893, State: Running, Role: LEADER
I20260809 22:53:47.414865 16634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:53:47.415632 16626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:53:47.418171 16636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96977594b5bc4b50baeaa32d228f4893. Latest consensus state: current_term: 1 leader_uuid: "96977594b5bc4b50baeaa32d228f4893" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } } }
I20260809 22:53:47.418522 16636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:47.419116 16635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96977594b5bc4b50baeaa32d228f4893" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } } }
I20260809 22:53:47.419464 16635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: This master's current role is: LEADER
I20260809 22:53:47.419551 16644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:53:47.427762 16644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:53:47.440845 16644 catalog_manager.cc:1347] Generated new cluster ID: b30772dfb5c04d568254bad893e6e248
I20260809 22:53:47.440994 16644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:53:47.481745 16644 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:53:47.483786 16644 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:53:47.493996 16644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Generated new TSK 0
I20260809 22:53:47.495139 16644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:53:47.579847 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:44949
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:47.936803 16663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:47.937170 16663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:47.937377 16663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:47.945147 16663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:47.945281 16663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:47.945501 16663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:53:47.955715 16663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:47.957085 16663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:47.958427 16663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:47.971939 16675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:47.972013 16672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:47.972656 16671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:47.973258 16663 server_base.cc:1034] running on GCE node
I20260809 22:53:47.973886 16663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:47.974857 16663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:47.976071 16663 hybrid_clock.cc:648] HybridClock initialized: now 1786316027975993 us; error 75 us; skew 500 ppm
I20260809 22:53:47.976413 16663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:47 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316027, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:47.979765 16663 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:53:47.981676 16663 webserver.cc:460] Webserver started at http://127.23.131.65:43247/ using document root <none> and password file <none>
I20260809 22:53:47.982481 16663 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:47.982653 16663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:47.983023 16663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:47.986320 16663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "42ac67296b054fe8b3159d85ff867aff"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "1911f32ca3272079ad34eb4b6b790f86"
server_key_iv: "09711bb0db2b2a8395f557909f6df367"
server_key_version: "encryptionkey@0"
I20260809 22:53:47.987255 16663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "42ac67296b054fe8b3159d85ff867aff"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "1911f32ca3272079ad34eb4b6b790f86"
server_key_iv: "09711bb0db2b2a8395f557909f6df367"
server_key_version: "encryptionkey@0"
I20260809 22:53:47.993080 16663 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260809 22:53:47.997403 16688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:47.999045 16663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:53:47.999284 16663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "42ac67296b054fe8b3159d85ff867aff"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "1911f32ca3272079ad34eb4b6b790f86"
server_key_iv: "09711bb0db2b2a8395f557909f6df367"
server_key_version: "encryptionkey@0"
I20260809 22:53:47.999562 16663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:48.016368 16663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:48.021560 16663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:48.021965 16663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:48.023154 16663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:48.024760 16663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:48.024847 16663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:48.025089 16663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:48.025171 16663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:48.061849 16663 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:39625
I20260809 22:53:48.061931 16847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:39625 every 8 connection(s)
I20260809 22:53:48.063254 16663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:53:48.067252 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 16663
I20260809 22:53:48.067477 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:53:48.068217 24077 external_mini_cluster.cc:1428] Setting key 333bd906890d0a53871ec161415325ac
Aug 09 22:53:48 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316027, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:48.084501 16850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:48.065874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:48571 (local address 127.23.131.126:44949)
0809 22:53:48.066363 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:48.066368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:48.067543 (+ 1175us) server_negotiation.cc:407] Connection header received
0809 22:53:48.069705 (+ 2162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:48.069709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:48.069771 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:48.069861 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:48.071588 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.072313 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.073884 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.074295 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.074436 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:48.078475 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:48.078480 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:48.078483 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:48.078518 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:48.081216 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:48.082151 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:48.082155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:48.082157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:48.082278 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:48.082785 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:48.082789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:48.082790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:48.083043 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:48.083155 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:48.084070 (+ 915us) server_negotiation.cc:299] Negotiation successful
0809 22:53:48.084241 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":258,"threads_started":1}
I20260809 22:53:48.086009 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:48.066444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:48571)
0809 22:53:48.067352 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:48.067404 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:48.069402 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:48.070174 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:48.070185 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:48.070779 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:48.071414 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:48.071433 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.072483 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.072489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:48.073725 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:48.073738 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.074545 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.074555 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:48.074786 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:48.075522 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:48.075546 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:48.078253 (+ 2707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:48.081359 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:48.081372 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:48.081390 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:48.082028 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:48.082382 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:48.082389 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:48.082395 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:48.082671 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:48.083170 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:48.083181 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:48.083664 (+ 483us) client_negotiation.cc:769] Sending connection context
0809 22:53:48.083969 (+ 305us) client_negotiation.cc:240] Negotiation successful
0809 22:53:48.084544 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":384,"threads_started":1}
I20260809 22:53:48.087699 16848 heartbeater.cc:347] Connected to a master server at 127.23.131.126:44949
I20260809 22:53:48.088028 16848 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:48.088765 16848 heartbeater.cc:511] Master 127.23.131.126:44949 requested a full tablet report, sending...
I20260809 22:53:48.090890 16580 ts_manager.cc:194] Registered new tserver with Master: 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625)
I20260809 22:53:48.092409 16580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:48571
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:53:48.144976 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:44949
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:48.501735 16859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:48.502014 16859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:48.502112 16859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:48.510223 16859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:48.510366 16859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:48.510550 16859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:53:48.520781 16859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:48.522188 16859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:48.523571 16859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:48.537425 16876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:48.537479 16872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:48.537438 16870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:48.538271 16859 server_base.cc:1034] running on GCE node
I20260809 22:53:48.538990 16859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:48.540145 16859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:48.541443 16859 hybrid_clock.cc:648] HybridClock initialized: now 1786316028541386 us; error 50 us; skew 500 ppm
I20260809 22:53:48.541776 16859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:48 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316028, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:48.545145 16859 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:53:48.546712 16859 webserver.cc:460] Webserver started at http://127.23.131.66:34455/ using document root <none> and password file <none>
I20260809 22:53:48.547515 16859 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:48.547667 16859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:48.547991 16859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:48.551007 16859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "ae3b87271d07493bb0f5ab05baf01968"
format_stamp: "Formatted at 2026-08-09 22:53:48 on dist-test-slave-92m1"
server_key: "f2d0eeb07e43a9d24a6e9332170eddda"
server_key_iv: "1ead0dbf960d4c72ff8086a5d5be636e"
server_key_version: "encryptionkey@0"
I20260809 22:53:48.551867 16859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "ae3b87271d07493bb0f5ab05baf01968"
format_stamp: "Formatted at 2026-08-09 22:53:48 on dist-test-slave-92m1"
server_key: "f2d0eeb07e43a9d24a6e9332170eddda"
server_key_iv: "1ead0dbf960d4c72ff8086a5d5be636e"
server_key_version: "encryptionkey@0"
I20260809 22:53:48.557226 16859 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:53:48.560766 16884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:48.562155 16859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:53:48.562342 16859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "ae3b87271d07493bb0f5ab05baf01968"
format_stamp: "Formatted at 2026-08-09 22:53:48 on dist-test-slave-92m1"
server_key: "f2d0eeb07e43a9d24a6e9332170eddda"
server_key_iv: "1ead0dbf960d4c72ff8086a5d5be636e"
server_key_version: "encryptionkey@0"
I20260809 22:53:48.562573 16859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:48.594554 16859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:48.600940 16859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:48.601276 16859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:48.602423 16859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:48.604628 16859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:48.604744 16859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:48.604907 16859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:48.604995 16859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:48.641021 16859 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46657
I20260809 22:53:48.641073 17061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46657 every 8 connection(s)
I20260809 22:53:48.642391 16859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:53:48.650427 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 16859
I20260809 22:53:48.650640 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:53:48.651116 24077 external_mini_cluster.cc:1428] Setting key d8fac49a546983f86044b9183d24f7f0
Aug 09 22:53:48 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316028, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:48.663394 17066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:48.645061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:56141 (local address 127.23.131.126:44949)
0809 22:53:48.645555 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:48.645559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:48.646436 (+ 877us) server_negotiation.cc:407] Connection header received
0809 22:53:48.648384 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:48.648390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:48.648481 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:48.648616 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:48.650101 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.650938 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.652776 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.653319 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.653416 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:48.657538 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:48.657543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:48.657546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:48.657578 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:48.660268 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:48.661036 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:48.661040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:48.661042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:48.661170 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:48.661625 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:48.661629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:48.661631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:48.661883 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:48.662072 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:48.662736 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 22:53:48.662963 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":279,"threads_started":1}
I20260809 22:53:48.664361 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:48.645576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:56141)
0809 22:53:48.646276 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:48.646319 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:48.648113 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:48.648849 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:48.648857 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:48.649372 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:48.649913 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:48.649929 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.651113 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.651117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:48.652604 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:48.652631 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:48.653547 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:48.653555 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:48.653851 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:48.654567 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:48.654600 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:48.657306 (+ 2706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:48.660434 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:48.660443 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:48.660459 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:48.660892 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:48.661289 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:48.661293 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:48.661297 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:48.661497 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:48.662021 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:48.662028 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:48.662370 (+ 342us) client_negotiation.cc:769] Sending connection context
0809 22:53:48.662646 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 22:53:48.663160 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":297,"threads_started":1}
I20260809 22:53:48.665927 17063 heartbeater.cc:347] Connected to a master server at 127.23.131.126:44949
I20260809 22:53:48.666257 17063 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:48.666997 17063 heartbeater.cc:511] Master 127.23.131.126:44949 requested a full tablet report, sending...
I20260809 22:53:48.668562 16580 ts_manager.cc:194] Registered new tserver with Master: ae3b87271d07493bb0f5ab05baf01968 (127.23.131.66:46657)
I20260809 22:53:48.669376 16580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:56141
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:53:48.730547 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:44949
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:53:49.085897 17072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:53:49.086197 17072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:53:49.086297 17072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:53:49.093686 17072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:53:49.093824 17072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:53:49.093945 17072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:53:49.095388 16848 heartbeater.cc:503] Master 127.23.131.126:44949 was elected leader, sending a full tablet report...
I20260809 22:53:49.104651 17072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:53:49.106005 17072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:53:49.107414 17072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:53:49.121214 17080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:49.121214 17083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:53:49.121466 17079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:53:49.122018 17072 server_base.cc:1034] running on GCE node
I20260809 22:53:49.122680 17072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:53:49.123697 17072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:53:49.124912 17072 hybrid_clock.cc:648] HybridClock initialized: now 1786316029124857 us; error 39 us; skew 500 ppm
I20260809 22:53:49.125250 17072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:53:49 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316029, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:53:49.128482 17072 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:53:49.130040 17072 webserver.cc:460] Webserver started at http://127.23.131.67:38331/ using document root <none> and password file <none>
I20260809 22:53:49.130745 17072 fs_manager.cc:359] Metadata directory not provided
I20260809 22:53:49.130904 17072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:53:49.131276 17072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:53:49.134841 17072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "1a2e73ee15574cd790cbeba677206833"
format_stamp: "Formatted at 2026-08-09 22:53:49 on dist-test-slave-92m1"
server_key: "240e226c843e5364f0134a3729adf77c"
server_key_iv: "dcce96c51d5d748ea67d71dda2fea0f7"
server_key_version: "encryptionkey@0"
I20260809 22:53:49.135699 17072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "1a2e73ee15574cd790cbeba677206833"
format_stamp: "Formatted at 2026-08-09 22:53:49 on dist-test-slave-92m1"
server_key: "240e226c843e5364f0134a3729adf77c"
server_key_iv: "dcce96c51d5d748ea67d71dda2fea0f7"
server_key_version: "encryptionkey@0"
I20260809 22:53:49.141110 17072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:53:49.144604 17093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:49.145876 17072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 22:53:49.146062 17072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "1a2e73ee15574cd790cbeba677206833"
format_stamp: "Formatted at 2026-08-09 22:53:49 on dist-test-slave-92m1"
server_key: "240e226c843e5364f0134a3729adf77c"
server_key_iv: "dcce96c51d5d748ea67d71dda2fea0f7"
server_key_version: "encryptionkey@0"
I20260809 22:53:49.146281 17072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:53:49.161303 17072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:53:49.165694 17072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:53:49.166004 17072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:53:49.167104 17072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:53:49.168713 17072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:53:49.168821 17072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:49.168977 17072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:53:49.169057 17072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:53:49.205161 17072 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:35861
I20260809 22:53:49.205201 17262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:35861 every 8 connection(s)
I20260809 22:53:49.206586 17072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:53:49.207109 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 17072
I20260809 22:53:49.207437 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:53:49.208128 24077 external_mini_cluster.cc:1428] Setting key 0e240846ae14794eda39601d0387dd56
Aug 09 22:53:49 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316029, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:53:49.228652 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.209694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:34459 (local address 127.23.131.126:44949)
0809 22:53:49.210166 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.210172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.211566 (+ 1394us) server_negotiation.cc:407] Connection header received
0809 22:53:49.214328 (+ 2762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.214334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.214423 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.214542 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:49.216419 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.217308 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.218797 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.219195 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.219360 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.222697 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:49.222703 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:49.222707 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:49.222743 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:49.225994 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.226669 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.226673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.226675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.226791 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.227152 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.227155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.227157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.227486 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:49.227622 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.228193 (+ 571us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.228352 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":221,"threads_started":1}
I20260809 22:53:49.229545 17270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.210352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:34459)
0809 22:53:49.211390 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:49.211446 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:49.214010 (+ 2564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:49.214779 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:49.214788 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:49.215689 (+ 901us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:53:49.216258 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.216276 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.217449 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.217453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.218675 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.218687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.219444 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.219449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.219659 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.220266 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:53:49.220287 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:53:49.222499 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:53:49.226123 (+ 3624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:49.226129 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:49.226140 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:49.226569 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:49.226882 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:53:49.226885 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:53:49.226887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:53:49.227061 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:53:49.227596 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:53:49.227602 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:53:49.227900 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 22:53:49.228116 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 22:53:49.228477 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":381,"threads_started":1}
I20260809 22:53:49.230789 17267 heartbeater.cc:347] Connected to a master server at 127.23.131.126:44949
I20260809 22:53:49.231114 17267 heartbeater.cc:464] Registering TS with master...
I20260809 22:53:49.231869 17267 heartbeater.cc:511] Master 127.23.131.126:44949 requested a full tablet report, sending...
I20260809 22:53:49.233323 16580 ts_manager.cc:194] Registered new tserver with Master: 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861)
I20260809 22:53:49.234141 16580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:34459
I20260809 22:53:49.237308 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:53:49.255482 17269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.241909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56344 (local address 127.23.131.126:44949)
0809 22:53:49.242135 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.242142 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.242451 (+ 309us) server_negotiation.cc:407] Connection header received
0809 22:53:49.242621 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.242625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.242684 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.242765 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:49.244321 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.245041 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.246373 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.246794 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.246889 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.249537 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:49.249542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:49.249545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:49.249580 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:49.252694 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.253472 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.253476 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.253486 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.253621 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.253998 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.254002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.254004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.254336 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:49.254547 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.254840 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.255068 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 22:53:49.260059 16580 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:53:49.267190 16580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:53:49.292999 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.281272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39846 (local address 127.23.131.67:35861)
0809 22:53:49.283667 (+ 2395us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.283676 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.284254 (+ 578us) server_negotiation.cc:407] Connection header received
0809 22:53:49.284613 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.284621 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.284839 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.285031 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:49.285931 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.287531 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.289782 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.291339 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.291477 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.291743 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.292427 (+ 684us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.292612 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2176,"thread_start_us":3193,"threads_started":1}
I20260809 22:53:49.293054 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.280641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48362 (local address 127.23.131.65:39625)
0809 22:53:49.282685 (+ 2044us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.282694 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.282725 (+ 31us) server_negotiation.cc:407] Connection header received
0809 22:53:49.282826 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.282834 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.284313 (+ 1479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.284514 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:49.285531 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.287030 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.290047 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.291598 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.291738 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.291979 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.292526 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.292728 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1877,"thread_start_us":1680,"threads_started":1}
I20260809 22:53:49.293089 17290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.280561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35861 (local address 127.0.0.1:39846)
0809 22:53:49.284123 (+ 3562us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:49.284142 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:49.284375 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:49.285147 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:49.285151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:49.285183 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:49.285683 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.285697 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.287719 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.287724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.289604 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.289617 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.291881 (+ 2264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.291888 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.292129 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.292196 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 22:53:49.292354 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 22:53:49.292564 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3429,"mutex_wait_us":105,"thread_start_us":1074,"threads_started":1}
I20260809 22:53:49.293358 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.283357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46657 (local address 127.0.0.1:54994)
0809 22:53:49.284452 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:49.284470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:49.284597 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:49.285725 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:49.285729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:49.285761 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:49.286136 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.286151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.288048 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.288053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.290275 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.290286 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.292232 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.292237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.292394 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.292427 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 22:53:49.292516 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 22:53:49.292672 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":952,"mutex_wait_us":3,"thread_start_us":910,"threads_started":1}
I20260809 22:53:49.293607 17296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.284060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54994 (local address 127.23.131.66:46657)
0809 22:53:49.285143 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.285151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.285174 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:53:49.285273 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.285280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.285506 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.285723 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:49.286326 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.287876 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.290426 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.291797 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.291939 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.292097 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.293095 (+ 998us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.293297 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":932,"thread_start_us":787,"threads_started":1}
I20260809 22:53:49.294009 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.280280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39625 (local address 127.0.0.1:48362)
0809 22:53:49.281649 (+ 1369us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:49.281701 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:49.281930 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:49.284822 (+ 2892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:49.284830 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:49.284860 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:49.285338 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.285350 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.287234 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.287238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.289866 (+ 2628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.289883 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.292121 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.292127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.292281 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.292324 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 22:53:49.292397 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 22:53:49.293621 (+ 1224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1040,"mutex_wait_us":1054,"thread_start_us":3555,"threads_started":1}
I20260809 22:53:49.297518 16961 tablet_service.cc:1467] Processing CreateTablet for tablet 0699e972133f49ae87ef4b13234ee5b1 (DEFAULT_TABLE table=test-table [id=cd16427e169040458200c6784ba8ab24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:49.297535 16755 tablet_service.cc:1467] Processing CreateTablet for tablet 0699e972133f49ae87ef4b13234ee5b1 (DEFAULT_TABLE table=test-table [id=cd16427e169040458200c6784ba8ab24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:49.297531 17174 tablet_service.cc:1467] Processing CreateTablet for tablet 0699e972133f49ae87ef4b13234ee5b1 (DEFAULT_TABLE table=test-table [id=cd16427e169040458200c6784ba8ab24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:53:49.298877 16961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0699e972133f49ae87ef4b13234ee5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:49.299011 17174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0699e972133f49ae87ef4b13234ee5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:49.299012 16755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0699e972133f49ae87ef4b13234ee5b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:53:49.312570 17298 tablet_bootstrap.cc:492] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Bootstrap starting.
I20260809 22:53:49.316371 17298 tablet_bootstrap.cc:654] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:49.317587 17298 log.cc:824] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:49.320288 17300 tablet_bootstrap.cc:492] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Bootstrap starting.
I20260809 22:53:49.320453 17303 tablet_bootstrap.cc:492] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Bootstrap starting.
I20260809 22:53:49.321211 17298 tablet_bootstrap.cc:492] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: No bootstrap required, opened a new log
I20260809 22:53:49.321561 17298 ts_tablet_manager.cc:1397] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 22:53:49.323463 17300 tablet_bootstrap.cc:654] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:49.323900 17303 tablet_bootstrap.cc:654] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Neither blocks nor log segments found. Creating new log.
I20260809 22:53:49.324527 17300 log.cc:824] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:49.325124 17303 log.cc:824] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Log is configured to *not* fsync() on all Append() calls
I20260809 22:53:49.327688 17303 tablet_bootstrap.cc:492] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: No bootstrap required, opened a new log
I20260809 22:53:49.327698 17300 tablet_bootstrap.cc:492] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: No bootstrap required, opened a new log
I20260809 22:53:49.327950 17303 ts_tablet_manager.cc:1397] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 22:53:49.327981 17300 ts_tablet_manager.cc:1397] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260809 22:53:49.332751 17298 raft_consensus.cc:348] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.333212 17298 raft_consensus.cc:374] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:49.333321 17298 raft_consensus.cc:729] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3b87271d07493bb0f5ab05baf01968, State: Initialized, Role: FOLLOWER
I20260809 22:53:49.333994 17298 consensus_queue.cc:260] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.335253 17063 heartbeater.cc:503] Master 127.23.131.126:44949 was elected leader, sending a full tablet report...
I20260809 22:53:49.335947 17298 ts_tablet_manager.cc:1428] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260809 22:53:49.336808 17303 raft_consensus.cc:348] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.337253 17303 raft_consensus.cc:374] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:49.337357 17303 raft_consensus.cc:729] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a2e73ee15574cd790cbeba677206833, State: Initialized, Role: FOLLOWER
I20260809 22:53:49.337932 17303 consensus_queue.cc:260] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.339102 17267 heartbeater.cc:503] Master 127.23.131.126:44949 was elected leader, sending a full tablet report...
I20260809 22:53:49.339792 17303 ts_tablet_manager.cc:1428] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260809 22:53:49.340010 17300 raft_consensus.cc:348] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.340440 17300 raft_consensus.cc:374] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:53:49.340552 17300 raft_consensus.cc:729] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ac67296b054fe8b3159d85ff867aff, State: Initialized, Role: FOLLOWER
I20260809 22:53:49.341172 17300 consensus_queue.cc:260] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.342932 17300 ts_tablet_manager.cc:1428] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Time spent starting tablet: real 0.015s user 0.007s sys 0.006s
W20260809 22:53:49.394713 17064 tablet.cc:2369] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:53:49.458606 17268 tablet.cc:2369] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:53:49.466745 17310 raft_consensus.cc:482] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:53:49.467054 17310 raft_consensus.cc:504] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.468894 17310 leader_election.cc:288] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625), 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861)
I20260809 22:53:49.478307 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.469377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:60643 (local address 127.23.131.67:35861)
0809 22:53:49.469822 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.469828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.470379 (+ 551us) server_negotiation.cc:407] Connection header received
0809 22:53:49.470471 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.470476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.470557 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.470669 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:49.471550 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.472769 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.475884 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.477131 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.477309 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.477384 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.477906 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.478037 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280}
I20260809 22:53:49.478309 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.469438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:52679 (local address 127.23.131.65:39625)
0809 22:53:49.469699 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.469706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.470221 (+ 515us) server_negotiation.cc:407] Connection header received
0809 22:53:49.470461 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.470467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.470573 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.470669 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:53:49.471641 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.472769 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.475886 (+ 3117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.477162 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.477312 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.477384 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.477906 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.478063 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 22:53:49.478559 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.469248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39625 (local address 127.23.131.66:52679)
0809 22:53:49.470072 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:49.470098 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:49.470285 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:49.470867 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:49.470872 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:49.470948 (+ 76us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:49.471468 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.471484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.472952 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.472959 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.475714 (+ 2755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.475729 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.477464 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.477471 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.477683 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.477764 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 22:53:49.477861 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 22:53:49.478047 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":243,"thread_start_us":387,"threads_started":1}
I20260809 22:53:49.478637 17319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.469332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35861 (local address 127.23.131.66:60643)
0809 22:53:49.470237 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0809 22:53:49.470255 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:53:49.470366 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:53:49.470709 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:53:49.470714 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:53:49.470744 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:53:49.471359 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.471375 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.472924 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.472929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.475716 (+ 2787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:53:49.475729 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.477459 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.477465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:53:49.477687 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.477759 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 22:53:49.477861 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:53:49.478047 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"mutex_wait_us":298,"spinlock_wait_cycles":32512,"thread_start_us":568,"threads_started":1}
I20260809 22:53:49.479597 17197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0699e972133f49ae87ef4b13234ee5b1" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a2e73ee15574cd790cbeba677206833" is_pre_election: true
I20260809 22:53:49.479686 16786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0699e972133f49ae87ef4b13234ee5b1" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ac67296b054fe8b3159d85ff867aff" is_pre_election: true
I20260809 22:53:49.480165 17197 raft_consensus.cc:2454] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 0.
I20260809 22:53:49.480232 16786 raft_consensus.cc:2454] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 0.
I20260809 22:53:49.480906 16887 leader_election.cc:302] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a2e73ee15574cd790cbeba677206833, 42ac67296b054fe8b3159d85ff867aff, ae3b87271d07493bb0f5ab05baf01968; no voters:
I20260809 22:53:49.481319 17310 raft_consensus.cc:2781] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:53:49.481482 17310 raft_consensus.cc:482] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:53:49.481593 17310 raft_consensus.cc:3037] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:49.483913 17310 raft_consensus.cc:504] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.484512 17310 leader_election.cc:288] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 election: Requested vote from peers 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625), 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861)
I20260809 22:53:49.484977 16786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0699e972133f49ae87ef4b13234ee5b1" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ac67296b054fe8b3159d85ff867aff"
I20260809 22:53:49.485023 17197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0699e972133f49ae87ef4b13234ee5b1" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a2e73ee15574cd790cbeba677206833"
I20260809 22:53:49.485193 16786 raft_consensus.cc:3037] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:49.485240 17197 raft_consensus.cc:3037] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:53:49.487502 17197 raft_consensus.cc:2454] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 1.
I20260809 22:53:49.487505 16786 raft_consensus.cc:2454] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 1.
I20260809 22:53:49.487936 16887 leader_election.cc:302] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a2e73ee15574cd790cbeba677206833, ae3b87271d07493bb0f5ab05baf01968; no voters:
I20260809 22:53:49.488250 17310 raft_consensus.cc:2781] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:53:49.488731 17310 raft_consensus.cc:686] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 1 LEADER]: Becoming Leader. State: Replica: ae3b87271d07493bb0f5ab05baf01968, State: Running, Role: LEADER
I20260809 22:53:49.489265 17310 consensus_queue.cc:237] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } }
I20260809 22:53:49.493839 16580 catalog_manager.cc:5495] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae3b87271d07493bb0f5ab05baf01968 (127.23.131.66). New cstate: current_term: 1 leader_uuid: "ae3b87271d07493bb0f5ab05baf01968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } health_report { overall_health: HEALTHY } } }
I20260809 22:53:49.531096 17296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.525380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55004 (local address 127.23.131.66:46657)
0809 22:53:49.525622 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.525626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.525648 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:53:49.525848 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.525853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.525964 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.526111 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:53:49.526461 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.527408 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.528898 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.529355 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.529477 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.529992 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:53:49.530519 (+ 527us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:53:49.530639 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.530767 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.530841 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:53:49.540596 16786 raft_consensus.cc:1261] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Refusing update from remote peer ae3b87271d07493bb0f5ab05baf01968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:49.540596 17197 raft_consensus.cc:1261] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Refusing update from remote peer ae3b87271d07493bb0f5ab05baf01968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:53:49.541930 17310 consensus_queue.cc:1035] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:49.542723 17310 consensus_queue.cc:1035] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:53:49.572356 16580 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:49.572604 16580 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:53:49.576542 16580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Sending DeleteTablet for 3 replicas of tablet 0699e972133f49ae87ef4b13234ee5b1
I20260809 22:53:49.577791 16755 tablet_service.cc:1514] Processing DeleteTablet for tablet 0699e972133f49ae87ef4b13234ee5b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:49 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:48362
I20260809 22:53:49.577760 17174 tablet_service.cc:1514] Processing DeleteTablet for tablet 0699e972133f49ae87ef4b13234ee5b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:49 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:39846
I20260809 22:53:49.578924 16961 tablet_service.cc:1514] Processing DeleteTablet for tablet 0699e972133f49ae87ef4b13234ee5b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:53:49 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:54994
I20260809 22:53:49.579912 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 16663
I20260809 22:53:49.588686 17334 tablet_replica.cc:330] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: stopping tablet replica
I20260809 22:53:49.589042 17338 tablet_replica.cc:330] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: stopping tablet replica
I20260809 22:53:49.589255 17334 raft_consensus.cc:2229] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:49.589466 17338 raft_consensus.cc:2229] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:53:49.589905 17334 raft_consensus.cc:2258] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:49.590233 17338 raft_consensus.cc:2258] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:49.591166 17335 tablet_replica.cc:330] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: stopping tablet replica
I20260809 22:53:49.591627 17335 raft_consensus.cc:2229] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:53:49.592181 17335 raft_consensus.cc:2258] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:53:49.593330 17338 ts_tablet_manager.cc:1905] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:49.594852 17335 ts_tablet_manager.cc:1905] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:49.601073 17334 ts_tablet_manager.cc:1905] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:53:49.602430 17335 ts_tablet_manager.cc:1918] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:49.602684 17335 log.cc:1196] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/0699e972133f49ae87ef4b13234ee5b1
I20260809 22:53:49.603320 17335 ts_tablet_manager.cc:1939] T 0699e972133f49ae87ef4b13234ee5b1 P 1a2e73ee15574cd790cbeba677206833: Deleting consensus metadata
I20260809 22:53:49.605175 17338 ts_tablet_manager.cc:1918] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:49.605388 17338 log.cc:1196] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/0699e972133f49ae87ef4b13234ee5b1
I20260809 22:53:49.605427 16558 catalog_manager.cc:4841] TS 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861): tablet 0699e972133f49ae87ef4b13234ee5b1 (table test-table [id=cd16427e169040458200c6784ba8ab24]) successfully deleted
I20260809 22:53:49.605980 17338 ts_tablet_manager.cc:1939] T 0699e972133f49ae87ef4b13234ee5b1 P ae3b87271d07493bb0f5ab05baf01968: Deleting consensus metadata
I20260809 22:53:49.607733 17334 ts_tablet_manager.cc:1918] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:53:49.607915 17334 log.cc:1196] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/0699e972133f49ae87ef4b13234ee5b1
I20260809 22:53:49.607885 16557 catalog_manager.cc:4841] TS ae3b87271d07493bb0f5ab05baf01968 (127.23.131.66:46657): tablet 0699e972133f49ae87ef4b13234ee5b1 (table test-table [id=cd16427e169040458200c6784ba8ab24]) successfully deleted
I20260809 22:53:49.608438 17334 ts_tablet_manager.cc:1939] T 0699e972133f49ae87ef4b13234ee5b1 P 42ac67296b054fe8b3159d85ff867aff: Deleting consensus metadata
I20260809 22:53:49.609980 16560 catalog_manager.cc:4841] TS 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625): tablet 0699e972133f49ae87ef4b13234ee5b1 (table test-table [id=cd16427e169040458200c6784ba8ab24]) successfully deleted
Aug 09 22:53:49 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:53:49.622247 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.581272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48372 (local address 127.23.131.65:39625)
0809 22:53:49.581468 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.581475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.596624 (+ 15149us) server_negotiation.cc:407] Connection header received
0809 22:53:49.596861 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.596868 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.596974 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.597110 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:49.599643 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.601338 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.609420 (+ 8082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.610129 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.610257 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.614637 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:49.614655 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:49.614673 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:49.614717 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:49.618700 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.619647 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.619658 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.619662 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.619828 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.620313 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.620318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.620322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.620835 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:49.621211 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.621513 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.621800 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:53:49.623067 16843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:49.739807 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 16663
I20260809 22:53:49.773134 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 16859
Aug 09 22:53:49 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:53:49.796182 17296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.774084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55006 (local address 127.23.131.66:46657)
0809 22:53:49.774294 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.774300 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.774324 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:53:49.774484 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.774490 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.774580 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.774709 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:49.776332 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.777615 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.779128 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.779873 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.779999 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.788579 (+ 8580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:49.788596 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:49.788614 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:49.788677 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:49.792801 (+ 4124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.793777 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.793785 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.793787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.793973 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.794428 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.794432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.794434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.794824 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:49.795251 (+ 427us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.795559 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.795795 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 22:53:49.796994 17053 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:49.918318 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 16859
I20260809 22:53:49.948155 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 17072
Aug 09 22:53:49 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:53:49.963406 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:53:49.948946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39852 (local address 127.23.131.67:35861)
0809 22:53:49.949130 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 22:53:49.949135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:53:49.949155 (+ 20us) server_negotiation.cc:407] Connection header received
0809 22:53:49.949271 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:53:49.949275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:53:49.949345 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:53:49.949435 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:53:49.950803 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.951696 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.953050 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:53:49.953418 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:53:49.953521 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:53:49.957923 (+ 4402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:53:49.957939 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:53:49.957957 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:53:49.958002 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:53:49.960881 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.961594 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.961601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.961603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.961746 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:53:49.962071 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:53:49.962074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:53:49.962076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:53:49.962413 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:53:49.962655 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 22:53:49.962893 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 22:53:49.963060 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 22:53:49.964067 17256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:50.058473 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 17072
I20260809 22:53:50.085472 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 16533
I20260809 22:53:50.086737 16621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:53:50.200968 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 16533
I20260809 22:54:10.236953 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44949
--webserver_interface=127.23.131.126
--webserver_port=41289
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:10.599026 17344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:10.599437 17344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:10.599627 17344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:10.607131 17344 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 22:54:10.607302 17344 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 22:54:10.607395 17344 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 22:54:10.607468 17344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:54:10.607570 17344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:10.607676 17344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:10.607764 17344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:54:10.607846 17344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:54:10.617996 17344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=41289
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:10.619415 17344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:10.620819 17344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:10.648933 17358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:10.649080 17356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:10.649008 17353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:10.649925 17344 server_base.cc:1034] running on GCE node
I20260809 22:54:10.650867 17344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:10.652628 17344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:10.653857 17344 hybrid_clock.cc:648] HybridClock initialized: now 1786316050653768 us; error 55 us; skew 500 ppm
I20260809 22:54:10.654275 17344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:10 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316050, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:10.658111 17344 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:54:10.660035 17344 webserver.cc:460] Webserver started at http://127.23.131.126:41289/ using document root <none> and password file <none>
I20260809 22:54:10.660802 17344 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:10.660913 17344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:10.667301 17344 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 22:54:10.670275 17367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:10.671736 17344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:54:10.671886 17344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "96977594b5bc4b50baeaa32d228f4893"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "90fca20de28d19363d9d5139530e08b0"
server_key_iv: "89e5745c7c95378901b5fbbe857e1345"
server_key_version: "encryptionkey@0"
I20260809 22:54:10.672941 17344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:10.684489 17344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:10.688563 17344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:10.688814 17344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:10.710001 17344 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:44949
I20260809 22:54:10.710005 17443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:44949 every 8 connection(s)
I20260809 22:54:10.711794 17344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:54:10.717017 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 17344
I20260809 22:54:10.717887 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:39625
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:44949
--webserver_port=43247
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:54:10.719424 17445 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:54:10.722841 17445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap starting.
I20260809 22:54:10.744776 17445 log.cc:824] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:10.757347 17445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:54:10.757952 17445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap complete.
I20260809 22:54:10.768087 17445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:10.769006 17445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96977594b5bc4b50baeaa32d228f4893, State: Initialized, Role: FOLLOWER
I20260809 22:54:10.769623 17445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:10.769888 17445 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:54:10.770037 17445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:54:10.770246 17445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 1 FOLLOWER]: Advancing to term 2
I20260809 22:54:10.774237 17445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:10.774782 17445 leader_election.cc:302] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96977594b5bc4b50baeaa32d228f4893; no voters:
I20260809 22:54:10.775615 17445 leader_election.cc:288] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 22:54:10.775753 17449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 22:54:10.777284 17449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 LEADER]: Becoming Leader. State: Replica: 96977594b5bc4b50baeaa32d228f4893, State: Running, Role: LEADER
I20260809 22:54:10.777945 17449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:10.778327 17445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:54:10.780582 17451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96977594b5bc4b50baeaa32d228f4893. Latest consensus state: current_term: 2 leader_uuid: "96977594b5bc4b50baeaa32d228f4893" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } } }
I20260809 22:54:10.780717 17450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "96977594b5bc4b50baeaa32d228f4893" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } } }
I20260809 22:54:10.781077 17451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:10.781589 17450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:10.792691 17463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:54:10.800945 17463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:54:10.802367 17463 catalog_manager.cc:1259] Loaded cluster ID: b30772dfb5c04d568254bad893e6e248
I20260809 22:54:10.802469 17463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:54:10.806468 17463 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:54:10.808115 17463 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Loaded TSK: 0
I20260809 22:54:10.843083 17463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Generated new TSK 1
I20260809 22:54:10.843500 17463 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 22:54:11.128888 17447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:11.129256 17447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:11.129428 17447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:11.137182 17447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:11.137367 17447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:11.137555 17447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:54:11.148234 17447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:39625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=43247
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:11.149655 17447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:11.151062 17447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:11.166653 17485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:11.167398 17484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:11.167879 17489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:11.167970 17447 server_base.cc:1034] running on GCE node
I20260809 22:54:11.168732 17447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:11.169862 17447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:11.171104 17447 hybrid_clock.cc:648] HybridClock initialized: now 1786316051171037 us; error 54 us; skew 500 ppm
I20260809 22:54:11.171530 17447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:11 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:11.175002 17447 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:54:11.176748 17447 webserver.cc:460] Webserver started at http://127.23.131.65:43247/ using document root <none> and password file <none>
I20260809 22:54:11.177484 17447 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:11.177659 17447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:11.183744 17447 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 22:54:11.186712 17500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:11.188228 17447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:54:11.188403 17447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "42ac67296b054fe8b3159d85ff867aff"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "1911f32ca3272079ad34eb4b6b790f86"
server_key_iv: "09711bb0db2b2a8395f557909f6df367"
server_key_version: "encryptionkey@0"
I20260809 22:54:11.189438 17447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:11.215893 17447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:11.220363 17447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:11.220670 17447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:11.221794 17447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:11.223261 17447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:11.223377 17447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:11.223520 17447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:11.223621 17447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:11.259970 17447 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:39625
I20260809 22:54:11.260118 17665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:39625 every 8 connection(s)
I20260809 22:54:11.261555 17447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:54:11.266588 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 17447
I20260809 22:54:11.267352 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:46657
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:44949
--webserver_port=34455
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:54:11 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:11.288894 17669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:11.264603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:38177 (local address 127.23.131.126:44949)
0809 22:54:11.265246 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:11.265268 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:11.265828 (+ 560us) server_negotiation.cc:407] Connection header received
0809 22:54:11.268666 (+ 2838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:11.268705 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:11.269176 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:11.269568 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:11.271030 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.273055 (+ 2025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.274693 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.275796 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.276003 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:11.280263 (+ 4260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:11.280276 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:11.280298 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:11.280357 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:11.284307 (+ 3950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:11.285365 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:11.285373 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:11.285377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:11.285539 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:11.286066 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:11.286069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:11.286071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:11.286520 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:11.286677 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:11.287643 (+ 966us) server_negotiation.cc:299] Negotiation successful
0809 22:54:11.287954 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":236,"threads_started":1}
I20260809 22:54:11.289443 17670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:11.264897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:38177)
0809 22:54:11.265654 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:11.265692 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:11.267847 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:11.269714 (+ 1867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:11.269721 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:11.270271 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:11.270819 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:11.270836 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.273257 (+ 2421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.273262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:11.274529 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:11.274543 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.276022 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.276027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:11.276310 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:11.277288 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:54:11.277323 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:11.279942 (+ 2619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:11.284462 (+ 4520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:11.284473 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:11.284493 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:11.285222 (+ 729us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:11.285678 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:11.285685 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:11.285692 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:11.285958 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:11.286678 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:11.286689 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:11.287120 (+ 431us) client_negotiation.cc:769] Sending connection context
0809 22:54:11.287465 (+ 345us) client_negotiation.cc:240] Negotiation successful
0809 22:54:11.288099 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":321,"threads_started":1}
I20260809 22:54:11.292420 17666 heartbeater.cc:347] Connected to a master server at 127.23.131.126:44949
I20260809 22:54:11.292764 17666 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:11.293569 17666 heartbeater.cc:511] Master 127.23.131.126:44949 requested a full tablet report, sending...
I20260809 22:54:11.296146 17391 ts_manager.cc:194] Registered new tserver with Master: 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625)
I20260809 22:54:11.297751 17391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:38177
W20260809 22:54:11.633445 17671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:11.633844 17671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:11.634037 17671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:11.641717 17671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:11.641888 17671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:11.642079 17671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:54:11.652448 17671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:46657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=34455
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:11.653837 17671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:11.655274 17671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:11.668967 17685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:11.669119 17684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:11.669047 17689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:11.672811 17671 server_base.cc:1034] running on GCE node
I20260809 22:54:11.673550 17671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:11.674767 17671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:11.676056 17671 hybrid_clock.cc:648] HybridClock initialized: now 1786316051675950 us; error 89 us; skew 500 ppm
I20260809 22:54:11.676429 17671 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:11 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:11.686394 17671 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:54:11.688023 17671 webserver.cc:460] Webserver started at http://127.23.131.66:34455/ using document root <none> and password file <none>
I20260809 22:54:11.688745 17671 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:11.688901 17671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:11.694809 17671 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 22:54:11.697598 17698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:11.699136 17671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 22:54:11.699385 17671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "ae3b87271d07493bb0f5ab05baf01968"
format_stamp: "Formatted at 2026-08-09 22:53:48 on dist-test-slave-92m1"
server_key: "f2d0eeb07e43a9d24a6e9332170eddda"
server_key_iv: "1ead0dbf960d4c72ff8086a5d5be636e"
server_key_version: "encryptionkey@0"
I20260809 22:54:11.700487 17671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:11.715303 17671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:11.720240 17671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:11.720556 17671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:11.721765 17671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:11.723290 17671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:11.723387 17671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:11.723562 17671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:11.723649 17671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:11.761101 17671 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46657
I20260809 22:54:11.761179 17865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46657 every 8 connection(s)
I20260809 22:54:11.762691 17671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:54:11.770797 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 17671
I20260809 22:54:11.771524 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:35861
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:44949
--webserver_port=38331
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 22:54:11 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:11.785786 17669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:11.765498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:34785 (local address 127.23.131.126:44949)
0809 22:54:11.765688 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:11.765692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:11.766784 (+ 1092us) server_negotiation.cc:407] Connection header received
0809 22:54:11.768731 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:11.768736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:11.768844 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:11.768957 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:11.770542 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.771410 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.774109 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.774550 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.774652 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:11.779493 (+ 4841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:11.779498 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:11.779501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:11.779537 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:11.782310 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:11.783297 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:11.783301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:11.783303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:11.783424 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:11.783939 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:11.783942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:11.783944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:11.784241 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:11.784355 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:11.785322 (+ 967us) server_negotiation.cc:299] Negotiation successful
0809 22:54:11.785531 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 22:54:11.787374 17871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:11.765903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:34785)
0809 22:54:11.766618 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:11.766663 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:11.768445 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:11.769201 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:11.769209 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:11.769739 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:11.770335 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:11.770361 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.771590 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.771596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:11.773920 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:11.773940 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:11.774793 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:11.774803 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:11.775135 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:11.775922 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:54:11.775959 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:11.779221 (+ 3262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:11.782463 (+ 3242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:11.782475 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:11.782496 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:11.783145 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:11.783536 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:11.783543 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:11.783549 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:11.783822 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:11.784372 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:11.784384 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:11.784877 (+ 493us) client_negotiation.cc:769] Sending connection context
0809 22:54:11.785206 (+ 329us) client_negotiation.cc:240] Negotiation successful
0809 22:54:11.785832 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":290,"threads_started":1}
I20260809 22:54:11.789099 17867 heartbeater.cc:347] Connected to a master server at 127.23.131.126:44949
I20260809 22:54:11.789422 17867 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:11.790253 17867 heartbeater.cc:511] Master 127.23.131.126:44949 requested a full tablet report, sending...
I20260809 22:54:11.791883 17391 ts_manager.cc:194] Registered new tserver with Master: ae3b87271d07493bb0f5ab05baf01968 (127.23.131.66:46657)
I20260809 22:54:11.792933 17391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:34785
W20260809 22:54:12.143460 17873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:12.143808 17873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:12.144026 17873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:12.151774 17873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:12.151948 17873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:12.152173 17873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:54:12.162698 17873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:35861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=38331
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:12.164145 17873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:12.165596 17873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:12.180189 17880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:12.180276 17883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:12.180310 17885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:12.181087 17873 server_base.cc:1034] running on GCE node
I20260809 22:54:12.181798 17873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:12.182835 17873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:12.184067 17873 hybrid_clock.cc:648] HybridClock initialized: now 1786316052184014 us; error 47 us; skew 500 ppm
I20260809 22:54:12.184405 17873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:12 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:12.187714 17873 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:54:12.189214 17873 webserver.cc:460] Webserver started at http://127.23.131.67:38331/ using document root <none> and password file <none>
I20260809 22:54:12.189992 17873 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:12.190201 17873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:12.196118 17873 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 22:54:12.198896 17893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:12.200670 17873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:54:12.200822 17873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "1a2e73ee15574cd790cbeba677206833"
format_stamp: "Formatted at 2026-08-09 22:53:49 on dist-test-slave-92m1"
server_key: "240e226c843e5364f0134a3729adf77c"
server_key_iv: "dcce96c51d5d748ea67d71dda2fea0f7"
server_key_version: "encryptionkey@0"
I20260809 22:54:12.201794 17873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:12.216332 17873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:12.220279 17873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:12.220521 17873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:12.221463 17873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:12.222785 17873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:12.222883 17873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:12.222996 17873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:12.223065 17873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:12.257791 17873 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:35861
I20260809 22:54:12.257886 18058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:35861 every 8 connection(s)
I20260809 22:54:12.259553 17873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:54:12.261376 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 17873
Aug 09 22:54:12 dist-test-slave-92m1 krb5kdc[16510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:12.280480 17669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.262877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49392 (local address 127.23.131.126:44949)
0809 22:54:12.263106 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.263112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.263597 (+ 485us) server_negotiation.cc:407] Connection header received
0809 22:54:12.264203 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.264208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.264299 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.264416 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:12.266695 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.267567 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.269731 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.270157 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.270252 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.273681 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:12.273685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:12.273689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:12.273721 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:12.277068 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.278039 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.278047 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.278050 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.278186 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.278647 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.278654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.278657 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.279024 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:12.279363 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.279736 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.280005 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 22:54:12.286013 18062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.263960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:41763 (local address 127.23.131.126:44949)
0809 22:54:12.266876 (+ 2916us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.266882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.266900 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:54:12.269332 (+ 2432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.269337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.269422 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.269542 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:12.271536 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.272291 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.274453 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.275291 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.275435 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.279484 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:12.279490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:12.279493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:12.279530 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:12.282639 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.283588 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.283593 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.283595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.283708 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.284180 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.284185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.284190 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.284458 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:12.284624 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.285342 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.285587 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":556,"threads_started":1}
I20260809 22:54:12.286980 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.264656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:41763)
0809 22:54:12.266610 (+ 1954us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:12.266676 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:12.269022 (+ 2346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:12.269824 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:12.269833 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:12.270497 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:12.271330 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.271359 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.272492 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.272500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.274298 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.274316 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.275522 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.275527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.275866 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.276502 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:54:12.276524 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:12.279183 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:12.282782 (+ 3599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:12.282791 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:12.282808 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:12.283445 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:12.283826 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:12.283831 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:12.283835 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:12.284049 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:12.284601 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:12.284610 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:12.284967 (+ 357us) client_negotiation.cc:769] Sending connection context
0809 22:54:12.285249 (+ 282us) client_negotiation.cc:240] Negotiation successful
0809 22:54:12.285813 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1619,"thread_start_us":1399,"threads_started":1}
I20260809 22:54:12.288581 18059 heartbeater.cc:347] Connected to a master server at 127.23.131.126:44949
I20260809 22:54:12.289012 18059 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:12.289857 18059 heartbeater.cc:511] Master 127.23.131.126:44949 requested a full tablet report, sending...
I20260809 22:54:12.291731 17391 ts_manager.cc:194] Registered new tserver with Master: 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861)
I20260809 22:54:12.292724 17391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:41763
I20260809 22:54:12.296411 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:54:12.301082 17666 heartbeater.cc:503] Master 127.23.131.126:44949 was elected leader, sending a full tablet report...
I20260809 22:54:12.306929 18062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.297535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49394 (local address 127.23.131.126:44949)
0809 22:54:12.297751 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.297760 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.298302 (+ 542us) server_negotiation.cc:407] Connection header received
0809 22:54:12.298678 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.298682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.298940 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.299143 (+ 203us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:54:12.301527 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.302592 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.304579 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.305108 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.305252 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.305844 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:54:12.306188 (+ 344us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 22:54:12.306657 (+ 469us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49394: token expired
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 22:54:12.307082 18062 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49394: token expired
W20260809 22:54:12.307653 17277 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.131.126:44949)
I20260809 22:54:12.321419 18062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.308245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49400 (local address 127.23.131.126:44949)
0809 22:54:12.308418 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.308422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.308502 (+ 80us) server_negotiation.cc:407] Connection header received
0809 22:54:12.308623 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.308627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.308682 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.308758 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:12.310228 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.310975 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.312496 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.312905 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.313026 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.316004 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:12.316008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:12.316011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:12.316046 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:12.318742 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.319602 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.319606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.319608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.319735 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.320157 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.320161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.320163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.320479 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:12.320698 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.320968 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.321148 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:54:12.325285 17391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:54:12.332981 17391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:54:12.374050 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.346558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43406 (local address 127.23.131.66:46657)
0809 22:54:12.366350 (+ 19792us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.366358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.366386 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:54:12.366487 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.366495 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.366712 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.366935 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:12.367628 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.369157 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.371812 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.372801 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.372983 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.373222 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.373543 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.373724 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19625,"thread_start_us":19514,"threads_started":1}
I20260809 22:54:12.374130 18072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.346060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46657 (local address 127.0.0.1:43406)
0809 22:54:12.362974 (+ 16914us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:12.363009 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:12.363165 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:12.366958 (+ 3793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:12.366966 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:12.366998 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:12.367424 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.367437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.369344 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.369350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.371649 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.371659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.373067 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.373074 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.373281 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.373327 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 22:54:12.373460 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 22:54:12.373658 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16732,"mutex_wait_us":8,"thread_start_us":10129,"threads_started":1}
I20260809 22:54:12.374733 18073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.346461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35861 (local address 127.0.0.1:38956)
0809 22:54:12.365228 (+ 18767us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:12.365249 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:12.365384 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:12.366465 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:12.366470 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:12.366501 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:12.366784 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.366791 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.368688 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.368693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.371271 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.371288 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.373717 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.373724 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.373904 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.373945 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 22:54:12.374064 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 22:54:12.374246 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18625,"mutex_wait_us":58,"thread_start_us":18446,"threads_started":1}
I20260809 22:54:12.375313 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.345969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39625 (local address 127.0.0.1:39188)
0809 22:54:12.356808 (+ 10839us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:12.356883 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:12.357159 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:12.365647 (+ 8488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:12.365656 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:12.365691 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:12.366241 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.366258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.368406 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.368412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.371053 (+ 2641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.371067 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.374330 (+ 3263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.374337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.374560 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.374599 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 22:54:12.374683 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 22:54:12.374842 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10429,"mutex_wait_us":5,"thread_start_us":17321,"threads_started":1}
I20260809 22:54:12.375738 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.347329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38956 (local address 127.23.131.67:35861)
0809 22:54:12.364170 (+ 16841us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.364186 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.365547 (+ 1361us) server_negotiation.cc:407] Connection header received
0809 22:54:12.365670 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.365678 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.365927 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.366158 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:12.367053 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.368518 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.371458 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.373049 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.373223 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.373530 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.375068 (+ 1538us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.375318 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16605,"thread_start_us":16391,"threads_started":1}
I20260809 22:54:12.376696 18074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.346390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39188 (local address 127.23.131.65:39625)
0809 22:54:12.364815 (+ 18425us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.364828 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.364864 (+ 36us) server_negotiation.cc:407] Connection header received
0809 22:54:12.364993 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.365004 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.365340 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.366387 (+ 1047us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:12.366648 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.368242 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.371265 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.374042 (+ 2777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.375737 (+ 1695us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.376013 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.376098 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.376289 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18225,"thread_start_us":18042,"threads_started":1}
I20260809 22:54:12.378904 17771 tablet_service.cc:1467] Processing CreateTablet for tablet 57b37eb62faa4a6fa67ab59e08cb5993 (DEFAULT_TABLE table=test-table [id=3118798100cc4a27b887524e46d61eef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:12.379843 17961 tablet_service.cc:1467] Processing CreateTablet for tablet 57b37eb62faa4a6fa67ab59e08cb5993 (DEFAULT_TABLE table=test-table [id=3118798100cc4a27b887524e46d61eef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:12.380579 17771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b37eb62faa4a6fa67ab59e08cb5993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:12.380209 17568 tablet_service.cc:1467] Processing CreateTablet for tablet 57b37eb62faa4a6fa67ab59e08cb5993 (DEFAULT_TABLE table=test-table [id=3118798100cc4a27b887524e46d61eef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:12.381285 17961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b37eb62faa4a6fa67ab59e08cb5993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:12.381675 17568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b37eb62faa4a6fa67ab59e08cb5993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:12.395041 18080 tablet_bootstrap.cc:492] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Bootstrap starting.
I20260809 22:54:12.397017 18082 tablet_bootstrap.cc:492] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Bootstrap starting.
I20260809 22:54:12.400005 18084 tablet_bootstrap.cc:492] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Bootstrap starting.
I20260809 22:54:12.400817 18080 tablet_bootstrap.cc:654] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:12.401212 18082 tablet_bootstrap.cc:654] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:12.402372 18080 log.cc:824] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:12.402532 18082 log.cc:824] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:12.402951 18084 tablet_bootstrap.cc:654] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:12.404277 18084 log.cc:824] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:12.406231 18080 tablet_bootstrap.cc:492] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: No bootstrap required, opened a new log
I20260809 22:54:12.406373 18082 tablet_bootstrap.cc:492] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: No bootstrap required, opened a new log
I20260809 22:54:12.406549 18080 ts_tablet_manager.cc:1397] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260809 22:54:12.406715 18082 ts_tablet_manager.cc:1397] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260809 22:54:12.407888 18084 tablet_bootstrap.cc:492] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: No bootstrap required, opened a new log
I20260809 22:54:12.408167 18084 ts_tablet_manager.cc:1397] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 22:54:12.414790 18082 raft_consensus.cc:348] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.415272 18082 raft_consensus.cc:374] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:12.415398 18082 raft_consensus.cc:729] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3b87271d07493bb0f5ab05baf01968, State: Initialized, Role: FOLLOWER
I20260809 22:54:12.416114 18082 consensus_queue.cc:260] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.417414 17867 heartbeater.cc:503] Master 127.23.131.126:44949 was elected leader, sending a full tablet report...
I20260809 22:54:12.417637 18080 raft_consensus.cc:348] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.418092 18080 raft_consensus.cc:374] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:12.418195 18080 raft_consensus.cc:729] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ac67296b054fe8b3159d85ff867aff, State: Initialized, Role: FOLLOWER
I20260809 22:54:12.418287 18082 ts_tablet_manager.cc:1428] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Time spent starting tablet: real 0.011s user 0.012s sys 0.001s
I20260809 22:54:12.418882 18080 consensus_queue.cc:260] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.420756 18080 ts_tablet_manager.cc:1428] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Time spent starting tablet: real 0.014s user 0.011s sys 0.003s
I20260809 22:54:12.420665 18084 raft_consensus.cc:348] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.421110 18084 raft_consensus.cc:374] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:12.421182 18084 raft_consensus.cc:729] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a2e73ee15574cd790cbeba677206833, State: Initialized, Role: FOLLOWER
I20260809 22:54:12.421890 18084 consensus_queue.cc:260] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.423952 18059 heartbeater.cc:503] Master 127.23.131.126:44949 was elected leader, sending a full tablet report...
I20260809 22:54:12.424610 18084 ts_tablet_manager.cc:1428] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260809 22:54:12.459271 18088 raft_consensus.cc:482] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:54:12.459702 18088 raft_consensus.cc:504] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.461434 18088 leader_election.cc:288] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625), 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861)
I20260809 22:54:12.468703 18074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.461858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:46585 (local address 127.23.131.65:39625)
0809 22:54:12.462086 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.462093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.462874 (+ 781us) server_negotiation.cc:407] Connection header received
0809 22:54:12.463113 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.463117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.463177 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.463306 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:12.463946 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.464697 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.466770 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.467619 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.467809 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.467898 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.468290 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.468423 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:54:12.468724 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.462013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:45025 (local address 127.23.131.67:35861)
0809 22:54:12.462274 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.462282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.462944 (+ 662us) server_negotiation.cc:407] Connection header received
0809 22:54:12.463161 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.463165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.463291 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.463391 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:12.464088 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.464806 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.466770 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.467662 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.467852 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.467931 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.468302 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.468440 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 22:54:12.468981 18091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.461652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39625 (local address 127.23.131.66:46585)
0809 22:54:12.462752 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:12.462768 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:12.462952 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:12.463322 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:12.463327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:12.463350 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:12.463784 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.463793 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.464842 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.464849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.466611 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.466623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.467868 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.467878 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.468119 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.468146 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 22:54:12.468251 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 22:54:12.468400 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":82,"thread_start_us":633,"threads_started":1}
I20260809 22:54:12.469125 18094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.461939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:35861 (local address 127.23.131.66:45025)
0809 22:54:12.462814 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:12.462829 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:12.463002 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:12.463411 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:12.463415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:12.463485 (+ 70us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:12.463917 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.463926 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.464949 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.464955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.466605 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:12.466618 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.467895 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.467901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:12.468136 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.468160 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 22:54:12.468268 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 22:54:12.468399 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":92,"spinlock_wait_cycles":1408,"thread_start_us":551,"threads_started":1}
I20260809 22:54:12.470104 17991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b37eb62faa4a6fa67ab59e08cb5993" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a2e73ee15574cd790cbeba677206833" is_pre_election: true
I20260809 22:54:12.470189 17594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b37eb62faa4a6fa67ab59e08cb5993" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ac67296b054fe8b3159d85ff867aff" is_pre_election: true
I20260809 22:54:12.470659 17991 raft_consensus.cc:2454] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 0.
I20260809 22:54:12.470683 17594 raft_consensus.cc:2454] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 0.
I20260809 22:54:12.471421 17704 leader_election.cc:302] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a2e73ee15574cd790cbeba677206833, 42ac67296b054fe8b3159d85ff867aff, ae3b87271d07493bb0f5ab05baf01968; no voters:
I20260809 22:54:12.471853 18088 raft_consensus.cc:2781] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:54:12.472003 18088 raft_consensus.cc:482] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:54:12.472123 18088 raft_consensus.cc:3037] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:12.474395 18088 raft_consensus.cc:504] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.475080 18088 leader_election.cc:288] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 election: Requested vote from peers 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625), 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861)
I20260809 22:54:12.475558 17594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b37eb62faa4a6fa67ab59e08cb5993" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ac67296b054fe8b3159d85ff867aff"
I20260809 22:54:12.475600 17991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b37eb62faa4a6fa67ab59e08cb5993" candidate_uuid: "ae3b87271d07493bb0f5ab05baf01968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a2e73ee15574cd790cbeba677206833"
I20260809 22:54:12.475749 17594 raft_consensus.cc:3037] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:12.475832 17991 raft_consensus.cc:3037] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:12.478138 17594 raft_consensus.cc:2454] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 1.
I20260809 22:54:12.478464 17991 raft_consensus.cc:2454] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae3b87271d07493bb0f5ab05baf01968 in term 1.
I20260809 22:54:12.478549 17704 leader_election.cc:302] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ac67296b054fe8b3159d85ff867aff, ae3b87271d07493bb0f5ab05baf01968; no voters:
I20260809 22:54:12.478833 18088 raft_consensus.cc:2781] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:54:12.479379 18088 raft_consensus.cc:686] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 1 LEADER]: Becoming Leader. State: Replica: ae3b87271d07493bb0f5ab05baf01968, State: Running, Role: LEADER
I20260809 22:54:12.479923 18088 consensus_queue.cc:237] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } }
I20260809 22:54:12.484496 17391 catalog_manager.cc:5495] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae3b87271d07493bb0f5ab05baf01968 (127.23.131.66). New cstate: current_term: 1 leader_uuid: "ae3b87271d07493bb0f5ab05baf01968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae3b87271d07493bb0f5ab05baf01968" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 } health_report { overall_health: UNKNOWN } } }
W20260809 22:54:12.511516 18060 tablet.cc:2369] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:54:12.515359 17667 tablet.cc:2369] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:54:12.517061 17870 tablet.cc:2369] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:54:12.525624 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.520405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.23.131.66:46657)
0809 22:54:12.520605 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.520610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.520629 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:54:12.520825 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.520829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.520911 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.521040 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:54:12.521378 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.522115 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.523516 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.523934 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.524028 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.524488 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:54:12.524985 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:54:12.525117 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.525269 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.525364 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:54:12.534400 17991 raft_consensus.cc:1261] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Refusing update from remote peer ae3b87271d07493bb0f5ab05baf01968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:54:12.534395 17594 raft_consensus.cc:1261] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Refusing update from remote peer ae3b87271d07493bb0f5ab05baf01968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:54:12.535457 18088 consensus_queue.cc:1035] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ac67296b054fe8b3159d85ff867aff" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:54:12.535765 18100 consensus_queue.cc:1035] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a2e73ee15574cd790cbeba677206833" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:54:12.563112 17391 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:54:12.563433 17391 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:54:12.566948 17391 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Sending DeleteTablet for 3 replicas of tablet 57b37eb62faa4a6fa67ab59e08cb5993
I20260809 22:54:12.568218 17568 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b37eb62faa4a6fa67ab59e08cb5993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:12 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:39188
I20260809 22:54:12.568292 17961 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b37eb62faa4a6fa67ab59e08cb5993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:12 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:38956
I20260809 22:54:12.569089 17771 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b37eb62faa4a6fa67ab59e08cb5993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:12 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:43406
I20260809 22:54:12.569334 18118 tablet_replica.cc:330] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: stopping tablet replica
I20260809 22:54:12.569809 18120 tablet_replica.cc:330] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: stopping tablet replica
I20260809 22:54:12.569830 18118 raft_consensus.cc:2229] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:54:12.570080 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 17447
I20260809 22:54:12.570199 18120 raft_consensus.cc:2229] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:54:12.570643 18118 raft_consensus.cc:2258] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:12.570708 18120 raft_consensus.cc:2258] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:12.573154 18120 ts_tablet_manager.cc:1905] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:12.581691 18120 ts_tablet_manager.cc:1918] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:12.581753 18122 tablet_replica.cc:330] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: stopping tablet replica
I20260809 22:54:12.581897 18120 log.cc:1196] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/57b37eb62faa4a6fa67ab59e08cb5993
I20260809 22:54:12.582329 18122 raft_consensus.cc:2229] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:54:12.582507 18120 ts_tablet_manager.cc:1939] T 57b37eb62faa4a6fa67ab59e08cb5993 P 1a2e73ee15574cd790cbeba677206833: Deleting consensus metadata
I20260809 22:54:12.583150 18122 raft_consensus.cc:2258] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:12.584900 17369 catalog_manager.cc:4841] TS 1a2e73ee15574cd790cbeba677206833 (127.23.131.67:35861): tablet 57b37eb62faa4a6fa67ab59e08cb5993 (table test-table [id=3118798100cc4a27b887524e46d61eef]) successfully deleted
I20260809 22:54:12.585317 18122 ts_tablet_manager.cc:1905] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:12.587028 18118 ts_tablet_manager.cc:1905] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:12.593667 18122 ts_tablet_manager.cc:1918] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:12.593897 18122 log.cc:1196] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/57b37eb62faa4a6fa67ab59e08cb5993
I20260809 22:54:12.594635 18122 ts_tablet_manager.cc:1939] T 57b37eb62faa4a6fa67ab59e08cb5993 P ae3b87271d07493bb0f5ab05baf01968: Deleting consensus metadata
I20260809 22:54:12.595067 18118 ts_tablet_manager.cc:1918] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:12.595270 18118 log.cc:1196] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/57b37eb62faa4a6fa67ab59e08cb5993
I20260809 22:54:12.595855 18118 ts_tablet_manager.cc:1939] T 57b37eb62faa4a6fa67ab59e08cb5993 P 42ac67296b054fe8b3159d85ff867aff: Deleting consensus metadata
I20260809 22:54:12.596311 18074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.571192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39190 (local address 127.23.131.65:39625)
0809 22:54:12.571382 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.571390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.572471 (+ 1081us) server_negotiation.cc:407] Connection header received
0809 22:54:12.572848 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.572857 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.572961 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.573080 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:12.575906 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.577481 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.580430 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.581357 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.581468 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.587237 (+ 5769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:12.587257 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:12.587277 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:12.587323 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:12.591531 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.592517 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.592528 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.592531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.592749 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.593248 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.593256 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.593263 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.593930 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:12.594603 (+ 673us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.595492 (+ 889us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.595751 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 22:54:12.596747 17368 catalog_manager.cc:4841] TS ae3b87271d07493bb0f5ab05baf01968 (127.23.131.66:46657): tablet 57b37eb62faa4a6fa67ab59e08cb5993 (table test-table [id=3118798100cc4a27b887524e46d61eef]) successfully deleted
I20260809 22:54:12.597564 17371 catalog_manager.cc:4841] TS 42ac67296b054fe8b3159d85ff867aff (127.23.131.65:39625): tablet 57b37eb62faa4a6fa67ab59e08cb5993 (table test-table [id=3118798100cc4a27b887524e46d61eef]) successfully deleted
I20260809 22:54:12.598343 17659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:12.690677 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 17447
I20260809 22:54:12.731745 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 17671
I20260809 22:54:12.748992 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.732592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43426 (local address 127.23.131.66:46657)
0809 22:54:12.732811 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.732817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.732839 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:54:12.733001 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.733006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.733135 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.733266 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:12.734694 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.736159 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.737511 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.738197 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.738336 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.741430 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:12.741453 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:12.741481 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:12.741537 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:12.745788 (+ 4251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.746552 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.746563 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.746567 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.746770 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.747140 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.747145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.747149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.747687 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:12.748047 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.748324 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.748574 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 22:54:12.749818 17858 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:12.870340 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 17671
I20260809 22:54:12.899977 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 17873
I20260809 22:54:12.914799 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:12.900786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38966 (local address 127.23.131.67:35861)
0809 22:54:12.900981 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:12.900989 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:12.901010 (+ 21us) server_negotiation.cc:407] Connection header received
0809 22:54:12.901215 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:12.901220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:12.901293 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:12.901404 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:12.902862 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.903706 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.905132 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:12.905553 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:12.905690 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:12.908491 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:12.908507 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:12.908524 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:12.908563 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:12.912102 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.912740 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.912747 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.912749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.912891 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:12.913304 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:12.913308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:12.913310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:12.913709 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:12.913946 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:12.914230 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 22:54:12.914409 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:54:12.915730 18051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:13.008121 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 17873
I20260809 22:54:13.031813 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 17344
I20260809 22:54:13.033084 17436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:13.153460 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 17344
I20260809 22:54:33.188321 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44949
--webserver_interface=127.23.131.126
--webserver_port=41289
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:33.558506 18128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:33.558847 18128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:33.559033 18128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:33.566409 18128 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 22:54:33.566568 18128 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 22:54:33.566653 18128 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 22:54:33.566728 18128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:54:33.566804 18128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:33.566901 18128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:33.566983 18128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:54:33.567062 18128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:54:33.577028 18128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=41289
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:33.578393 18128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:33.579903 18128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:33.592829 18136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:33.592861 18134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:33.592916 18138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:33.594102 18128 server_base.cc:1034] running on GCE node
I20260809 22:54:33.594907 18128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:33.596374 18128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:33.597606 18128 hybrid_clock.cc:648] HybridClock initialized: now 1786316073597545 us; error 35 us; skew 500 ppm
I20260809 22:54:33.597965 18128 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:33 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316073, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:33.604283 18128 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:54:33.605852 18128 webserver.cc:460] Webserver started at http://127.23.131.126:41289/ using document root <none> and password file <none>
I20260809 22:54:33.606555 18128 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:33.606648 18128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:33.612346 18128 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 22:54:33.615105 18147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:33.616470 18128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:54:33.616643 18128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "96977594b5bc4b50baeaa32d228f4893"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "90fca20de28d19363d9d5139530e08b0"
server_key_iv: "89e5745c7c95378901b5fbbe857e1345"
server_key_version: "encryptionkey@0"
I20260809 22:54:33.617679 18128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:33.648183 18128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:33.652385 18128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:33.652709 18128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:33.672536 18128 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:44949
I20260809 22:54:33.672569 18221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:44949 every 8 connection(s)
I20260809 22:54:33.674094 18128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:54:33.679029 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 18128
I20260809 22:54:33.679977 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:39625
--local_ip_for_outbound_sockets=127.23.131.65
--tserver_master_addrs=127.23.131.126:44949
--webserver_port=43247
--webserver_interface=127.23.131.65
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:54:33.681303 18222 sys_catalog.cc:263] Verifying existing consensus state
I20260809 22:54:33.684660 18222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap starting.
I20260809 22:54:33.706230 18222 log.cc:824] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:33.723100 18222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 22:54:33.723742 18222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Bootstrap complete.
I20260809 22:54:33.733548 18222 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:33.734503 18222 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96977594b5bc4b50baeaa32d228f4893, State: Initialized, Role: FOLLOWER
I20260809 22:54:33.735175 18222 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:33.735489 18222 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:54:33.735615 18222 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:54:33.735795 18222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 2 FOLLOWER]: Advancing to term 3
I20260809 22:54:33.739988 18222 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:33.740486 18222 leader_election.cc:302] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96977594b5bc4b50baeaa32d228f4893; no voters:
I20260809 22:54:33.741251 18222 leader_election.cc:288] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 22:54:33.741405 18231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 22:54:33.742970 18231 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [term 3 LEADER]: Becoming Leader. State: Replica: 96977594b5bc4b50baeaa32d228f4893, State: Running, Role: LEADER
I20260809 22:54:33.743568 18231 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } }
I20260809 22:54:33.743790 18222 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:54:33.746296 18232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "96977594b5bc4b50baeaa32d228f4893" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } } }
I20260809 22:54:33.746778 18232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:33.750844 18233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96977594b5bc4b50baeaa32d228f4893. Latest consensus state: current_term: 3 leader_uuid: "96977594b5bc4b50baeaa32d228f4893" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96977594b5bc4b50baeaa32d228f4893" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44949 } } }
I20260809 22:54:33.751266 18233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893 [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:33.752844 18237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:54:33.762380 18237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:54:33.763995 18237 catalog_manager.cc:1259] Loaded cluster ID: b30772dfb5c04d568254bad893e6e248
I20260809 22:54:33.764159 18237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:54:33.768699 18237 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:54:33.769970 18237 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Loaded TSK: 0
I20260809 22:54:33.770124 18237 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 96977594b5bc4b50baeaa32d228f4893: Loaded TSK: 1
F20260809 22:54:33.770968 18237 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f67339249ad google::LogMessage::Fail() at ??:0
@ 0x7f673392788a google::LogMessage::SendToLog() at ??:0
@ 0x7f67339244de google::LogMessage::Flush() at ??:0
@ 0x7f6733925a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f67376887d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f673767773e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f67493531c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f6749352783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f67493de2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f67493de0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f67494285e9 std::function<>::operator()() at ??:0
@ 0x7f6749356cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f6749354c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f67493dc610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f67493dc439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6736570345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f673657391c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f6736573799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f673654eeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f67398286db start_thread at ??:0
@ 0x7f67327be61f clone at ??:0
W20260809 22:54:34.110088 18228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:34.110445 18228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:34.110615 18228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:34.118242 18228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:34.118407 18228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:34.118604 18228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:54:34.128995 18228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:39625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=43247
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:34.130368 18228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:34.131803 18228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:34.145397 18293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:34.145467 18290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:34.145491 18291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:34.146642 18228 server_base.cc:1034] running on GCE node
I20260809 22:54:34.147400 18228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:34.148381 18228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:34.149613 18228 hybrid_clock.cc:648] HybridClock initialized: now 1786316074149569 us; error 30 us; skew 500 ppm
I20260809 22:54:34.149957 18228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:34 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316074, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:34.153324 18228 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:54:34.154803 18228 webserver.cc:460] Webserver started at http://127.23.131.65:43247/ using document root <none> and password file <none>
I20260809 22:54:34.155594 18228 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:34.155745 18228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:34.161285 18228 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 22:54:34.164088 18305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:34.165401 18228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:54:34.165580 18228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "42ac67296b054fe8b3159d85ff867aff"
format_stamp: "Formatted at 2026-08-09 22:53:47 on dist-test-slave-92m1"
server_key: "1911f32ca3272079ad34eb4b6b790f86"
server_key_iv: "09711bb0db2b2a8395f557909f6df367"
server_key_version: "encryptionkey@0"
I20260809 22:54:34.166664 18228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:34.192713 18228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:34.196980 18228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:34.197360 18228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:34.198429 18228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:34.199892 18228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:34.200019 18228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:34.200156 18228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:34.200259 18228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:34.236131 18228 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:39625
I20260809 22:54:34.236219 18481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:39625 every 8 connection(s)
I20260809 22:54:34.237636 18228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:54:34.238726 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 18228
I20260809 22:54:34.239857 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:46657
--local_ip_for_outbound_sockets=127.23.131.66
--tserver_master_addrs=127.23.131.126:44949
--webserver_port=34455
--webserver_interface=127.23.131.66
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:54:34.243304 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:34.241118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:37779)
0809 22:54:34.242011 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:34.242334 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":376,"threads_started":1}
W20260809 22:54:34.244148 18482 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:44949 (0 consecutive failures): Network error: Failed to ping master at 127.23.131.126:44949: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
I20260809 22:54:34.245048 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:34.244696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:57321)
0809 22:54:34.244856 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:34.244935 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 22:54:34.245922 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:34.245594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:37939)
0809 22:54:34.245728 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:34.245810 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 22:54:34.246218 18482 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 22:54:34.600099 18485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:34.600421 18485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:34.600625 18485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:34.608261 18485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:34.608392 18485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:34.608588 18485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:54:34.619086 18485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:46657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=34455
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:34.620556 18485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:34.621959 18485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:34.635766 18493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:34.635803 18494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:34.635845 18498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:34.637334 18485 server_base.cc:1034] running on GCE node
I20260809 22:54:34.638062 18485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:34.639103 18485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:34.640326 18485 hybrid_clock.cc:648] HybridClock initialized: now 1786316074640276 us; error 45 us; skew 500 ppm
I20260809 22:54:34.640657 18485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:34 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316074, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:34.643880 18485 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:54:34.645438 18485 webserver.cc:460] Webserver started at http://127.23.131.66:34455/ using document root <none> and password file <none>
I20260809 22:54:34.646150 18485 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:34.646298 18485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:34.651945 18485 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 22:54:34.654876 18507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:34.656225 18485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 22:54:34.656409 18485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "ae3b87271d07493bb0f5ab05baf01968"
format_stamp: "Formatted at 2026-08-09 22:53:48 on dist-test-slave-92m1"
server_key: "f2d0eeb07e43a9d24a6e9332170eddda"
server_key_iv: "1ead0dbf960d4c72ff8086a5d5be636e"
server_key_version: "encryptionkey@0"
I20260809 22:54:34.657490 18485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:34.690162 18485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:34.694301 18485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:34.694599 18485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:34.695674 18485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:34.697032 18485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:34.697151 18485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:34.697278 18485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:34.697368 18485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:34.732170 18485 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46657
I20260809 22:54:34.732273 18674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46657 every 8 connection(s)
I20260809 22:54:34.733680 18485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:54:34.738564 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 18485
I20260809 22:54:34.738926 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:34.736686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:37531)
0809 22:54:34.737404 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:34.737724 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":281,"threads_started":1}
I20260809 22:54:34.739447 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:35861
--local_ip_for_outbound_sockets=127.23.131.67
--tserver_master_addrs=127.23.131.126:44949
--webserver_port=38331
--webserver_interface=127.23.131.67
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:34.739706 18675 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:44949 (0 consecutive failures): Network error: Failed to ping master at 127.23.131.126:44949: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
I20260809 22:54:34.740597 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:34.740256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:35841)
0809 22:54:34.740407 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:34.740485 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 22:54:34.741458 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:34.741143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:46493)
0809 22:54:34.741276 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:34.741358 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 22:54:34.741667 18675 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 22:54:35.091492 18682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:35.091768 18682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:35.091864 18682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:35.099079 18682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:35.099188 18682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:35.099362 18682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:54:35.109486 18682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:35861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=38331
--tserver_master_addrs=127.23.131.126:44949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:35.110656 18682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:35.112004 18682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:35.124930 18691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:35.125077 18696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:35.125123 18693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:35.126233 18682 server_base.cc:1034] running on GCE node
I20260809 22:54:35.126786 18682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:35.127718 18682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:35.128907 18682 hybrid_clock.cc:648] HybridClock initialized: now 1786316075128853 us; error 53 us; skew 500 ppm
I20260809 22:54:35.129174 18682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:35 dist-test-slave-92m1 krb5kdc[16510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316075, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:35.132439 18682 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:54:35.133855 18682 webserver.cc:460] Webserver started at http://127.23.131.67:38331/ using document root <none> and password file <none>
I20260809 22:54:35.134478 18682 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:35.134584 18682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:35.139740 18682 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:54:35.142405 18708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:35.143735 18682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:54:35.143898 18682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "1a2e73ee15574cd790cbeba677206833"
format_stamp: "Formatted at 2026-08-09 22:53:49 on dist-test-slave-92m1"
server_key: "240e226c843e5364f0134a3729adf77c"
server_key_iv: "dcce96c51d5d748ea67d71dda2fea0f7"
server_key_version: "encryptionkey@0"
I20260809 22:54:35.144847 18682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:35.161866 18682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:35.166535 18682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:35.166836 18682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:35.167960 18682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:35.169369 18682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:35.169495 18682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:35.169643 18682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:35.169734 18682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:35.206332 18682 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:35861
I20260809 22:54:35.206432 18863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:35861 every 8 connection(s)
I20260809 22:54:35.207965 18682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:54:35.213137 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:35.211057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:33389)
0809 22:54:35.211903 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:35.212252 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":380,"threads_started":1}
W20260809 22:54:35.213830 18865 heartbeater.cc:644] Failed to heartbeat to 127.23.131.126:44949 (0 consecutive failures): Network error: Failed to ping master at 127.23.131.126:44949: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
I20260809 22:54:35.214744 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:35.214409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:34583)
0809 22:54:35.214548 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:35.214636 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 22:54:35.215737 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:35.215322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:37393)
0809 22:54:35.215485 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:35.215586 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 22:54:35.215723 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 18682
W20260809 22:54:35.216066 18865 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 22:54:35.247570 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:35.246739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:47651)
0809 22:54:35.247189 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:35.247333 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":207,"threads_started":1}
I20260809 22:54:35.742887 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:35.742123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:45691)
0809 22:54:35.742568 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:35.742662 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":223,"threads_started":1}
I20260809 22:54:36.217878 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:36.216775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:49343)
0809 22:54:36.217430 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:36.217553 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":407,"threads_started":1}
I20260809 22:54:36.249387 18879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:36.248563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:42361)
0809 22:54:36.249108 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:36.249195 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":249,"threads_started":1}
I20260809 22:54:36.744572 18880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:36.743792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:54653)
0809 22:54:36.744302 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:36.744386 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":284,"threads_started":1}
I20260809 22:54:37.219910 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:37.218992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:52043)
0809 22:54:37.219619 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:37.219730 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":349,"threads_started":1}
I20260809 22:54:37.251061 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:37.250357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:42195)
0809 22:54:37.250782 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:37.250862 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":224,"threads_started":1}
I20260809 22:54:37.746374 18885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:37.745515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:37863)
0809 22:54:37.746059 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:37.746171 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":306,"threads_started":1}
I20260809 22:54:38.221989 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:38.221069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:33675)
0809 22:54:38.221714 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:38.221799 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":431,"threads_started":1}
I20260809 22:54:38.252775 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:38.252029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:49567)
0809 22:54:38.252493 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:38.252586 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":240,"threads_started":1}
I20260809 22:54:38.747974 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:38.747239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:56413)
0809 22:54:38.747715 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:38.747798 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":235,"threads_started":1}
I20260809 22:54:39.224089 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:39.223151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:44119)
0809 22:54:39.223772 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:39.223861 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":314,"threads_started":1}
I20260809 22:54:39.254838 18895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:39.253966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:34999)
0809 22:54:39.254524 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:39.254653 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":293,"threads_started":1}
I20260809 22:54:39.749795 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:39.749012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:43241)
0809 22:54:39.749521 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:39.749606 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":260,"threads_started":1}
I20260809 22:54:40.225764 18897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:40.225053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:43537)
0809 22:54:40.225511 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:40.225594 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":233,"threads_started":1}
I20260809 22:54:40.256502 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:40.255803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:41987)
0809 22:54:40.256243 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:40.256351 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":241,"threads_started":1}
I20260809 22:54:40.751533 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:40.750734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:38591)
0809 22:54:40.751243 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:40.751352 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":233,"threads_started":1}
I20260809 22:54:41.227757 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:41.226881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:53969)
0809 22:54:41.227487 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:41.227587 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":365,"threads_started":1}
I20260809 22:54:41.258364 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:41.257519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:39771)
0809 22:54:41.258070 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:41.258156 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":250,"threads_started":1}
I20260809 22:54:41.753327 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:41.752420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:48601)
0809 22:54:41.752929 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:41.753022 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":234,"threads_started":1}
I20260809 22:54:42.229557 18905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:42.228756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:60975)
0809 22:54:42.229259 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:42.229341 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":223,"threads_started":1}
I20260809 22:54:42.260103 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:42.259409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:37685)
0809 22:54:42.259854 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:42.259935 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":226,"threads_started":1}
I20260809 22:54:42.754978 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:42.754278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:52847)
0809 22:54:42.754730 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:42.754816 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":234,"threads_started":1}
I20260809 22:54:43.231411 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:43.230513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:47043)
0809 22:54:43.231089 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:43.231175 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":340,"threads_started":1}
I20260809 22:54:43.262140 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:43.261146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:53213)
0809 22:54:43.261747 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:43.261899 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":292,"threads_started":1}
I20260809 22:54:43.756718 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:43.755902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:46761)
0809 22:54:43.756420 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:43.756533 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":257,"threads_started":1}
I20260809 22:54:44.233291 18916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:44.232395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:58183)
0809 22:54:44.232999 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:44.233099 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":268,"threads_started":1}
I20260809 22:54:44.263892 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:44.263142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:43853)
0809 22:54:44.263642 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:44.263728 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":289,"threads_started":1}
I20260809 22:54:44.758426 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:44.757717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:60459)
0809 22:54:44.758171 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:44.758257 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":252,"threads_started":1}
I20260809 22:54:45.235160 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:45.234344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:50007)
0809 22:54:45.234870 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:45.234968 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":287,"threads_started":1}
I20260809 22:54:45.265602 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:45.264827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:53615)
0809 22:54:45.265301 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:45.265400 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":247,"threads_started":1}
I20260809 22:54:45.760403 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:45.759456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:56277)
0809 22:54:45.760006 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:45.760135 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":246,"threads_started":1}
I20260809 22:54:46.237059 18923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:46.236210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:54543)
0809 22:54:46.236685 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:46.236802 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":221,"threads_started":1}
I20260809 22:54:46.267645 18924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:46.266691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:39659)
0809 22:54:46.267289 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:46.267408 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":280,"threads_started":1}
I20260809 22:54:46.762478 18925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:46.761566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:60445)
0809 22:54:46.762174 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:46.762279 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":342,"threads_started":1}
I20260809 22:54:47.239276 18926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:47.238272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:48195)
0809 22:54:47.238891 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:47.239002 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":332,"threads_started":1}
I20260809 22:54:47.269536 18927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:47.268711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:42397)
0809 22:54:47.269236 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:47.269342 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":232,"threads_started":1}
I20260809 22:54:47.764454 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:47.763607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:52989)
0809 22:54:47.764133 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:47.764239 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":246,"threads_started":1}
I20260809 22:54:48.241219 18930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:48.240421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:34159)
0809 22:54:48.240908 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:48.241009 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":236,"threads_started":1}
I20260809 22:54:48.271642 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:48.270697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:38591)
0809 22:54:48.271355 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:48.271451 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":376,"threads_started":1}
I20260809 22:54:48.766224 18932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:48.765453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:37659)
0809 22:54:48.765933 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:48.766023 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":235,"threads_started":1}
I20260809 22:54:49.243315 18933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:49.242425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:52859)
0809 22:54:49.242949 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:49.243044 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":248,"threads_started":1}
I20260809 22:54:49.273666 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:49.272866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:58079)
0809 22:54:49.273344 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:49.273473 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":248,"threads_started":1}
I20260809 22:54:49.768208 18936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:49.767472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.66:48937)
0809 22:54:49.767916 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:49.768015 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":231,"threads_started":1}
I20260809 22:54:50.227249 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 18228
I20260809 22:54:50.245350 18939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:50.244541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.67:47855)
0809 22:54:50.245067 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:50.245168 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":286,"threads_started":1}
I20260809 22:54:50.246747 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:50.228574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37782 (local address 127.23.131.65:39625)
0809 22:54:50.229458 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:50.229478 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:50.229530 (+ 52us) server_negotiation.cc:407] Connection header received
0809 22:54:50.231138 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:50.231148 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:50.231635 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:50.231991 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:50.233627 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:50.234866 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:50.236273 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:50.236949 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:50.237144 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:50.240088 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:50.240096 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:50.240115 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:50.240160 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:50.243051 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:50.243803 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:50.243813 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:50.243826 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:50.244004 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:50.244548 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:50.244552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:50.244554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:50.245128 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:50.245490 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:50.246032 (+ 542us) server_negotiation.cc:299] Negotiation successful
0809 22:54:50.246478 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":511,"threads_started":1}
I20260809 22:54:50.248309 18473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:50.334452 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 18228
I20260809 22:54:50.334558 18945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:50.333228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44949 (local address 127.23.131.65:40553)
0809 22:54:50.333896 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:50.334158 (+ 262us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.126:44949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":296,"threads_started":1}
I20260809 22:54:50.371261 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 18485
I20260809 22:54:50.392640 18947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:50.373060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47170 (local address 127.23.131.66:46657)
0809 22:54:50.375546 (+ 2486us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:50.375566 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:50.375602 (+ 36us) server_negotiation.cc:407] Connection header received
0809 22:54:50.377179 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:50.377189 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:50.377602 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:50.377960 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:50.379594 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:50.380799 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:50.382058 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:50.382735 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:50.382936 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:50.385778 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:50.385786 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:50.385802 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:50.385854 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:50.389170 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:50.389931 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:50.389938 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:50.389945 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:50.390135 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:50.390541 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:50.390546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:50.390549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:50.391084 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:50.391444 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:50.391891 (+ 447us) server_negotiation.cc:299] Negotiation successful
0809 22:54:50.392324 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2335,"thread_start_us":309,"threads_started":1}
I20260809 22:54:50.394086 18669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:50.482197 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 18485
I20260809 22:54:50.520002 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 18682
I20260809 22:54:50.540036 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:50.521184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59982 (local address 127.23.131.67:35861)
0809 22:54:50.521916 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:50.521931 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:50.521972 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:54:50.523916 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:50.523928 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:50.524359 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:50.524727 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:50.526328 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:50.527835 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:50.529177 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:50.529859 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:50.530073 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:50.532889 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:50.532897 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:50.532912 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:50.532953 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:50.536224 (+ 3271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:50.536983 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:50.536997 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:50.537004 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:50.537198 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:50.537638 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:50.537644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:50.537649 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:50.538221 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:50.538540 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:50.539068 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 22:54:50.539706 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":368,"threads_started":1}
I20260809 22:54:50.541661 18859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:50.633019 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 18682
2026-08-09T22:54:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65537 ms)
[----------] 30 tests from SecurityITest (315941 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:54:50 dist-test-slave-92m1 krb5kdc[18956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:54:50 dist-test-slave-92m1 krb5kdc[18956](info): set up 2 sockets
Aug 09 22:54:50 dist-test-slave-92m1 krb5kdc[18956](info): commencing operation
krb5kdc: starting...
W20260809 22:54:52.020049 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.003s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:54:52 dist-test-slave-92m1 krb5kdc[18956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:54:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:54:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:54:52.400710 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:33563
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:33563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:52.754112 18975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:52.754413 18975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:52.754568 18975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:52.761929 18975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:54:52.762069 18975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:52.762135 18975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:52.762272 18975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:54:52.762333 18975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:54:52.772558 18975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:33563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:33563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:52.773999 18975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:52.775385 18975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:52.787997 18981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:52.788065 18980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:52.788045 18986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:52.788764 18975 server_base.cc:1034] running on GCE node
I20260809 22:54:52.789541 18975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:52.790931 18975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:52.792173 18975 hybrid_clock.cc:648] HybridClock initialized: now 1786316092792110 us; error 70 us; skew 500 ppm
I20260809 22:54:52.792541 18975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:52 dist-test-slave-92m1 krb5kdc[18956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316092, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:52.801326 18975 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:54:52.803037 18975 webserver.cc:460] Webserver started at http://127.23.131.126:45391/ using document root <none> and password file <none>
I20260809 22:54:52.803835 18975 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:52.803996 18975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:52.804327 18975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:52.807628 18975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "27eecae8434346188d38ad96df45af6f"
format_stamp: "Formatted at 2026-08-09 22:54:52 on dist-test-slave-92m1"
server_key: "c2ed625ad82c4e590e5ac60058ecfab0"
server_key_iv: "ae01bc22d9200a41f302cc68959b02c5"
server_key_version: "encryptionkey@0"
I20260809 22:54:52.808444 18975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "27eecae8434346188d38ad96df45af6f"
format_stamp: "Formatted at 2026-08-09 22:54:52 on dist-test-slave-92m1"
server_key: "c2ed625ad82c4e590e5ac60058ecfab0"
server_key_iv: "ae01bc22d9200a41f302cc68959b02c5"
server_key_version: "encryptionkey@0"
I20260809 22:54:52.813802 18975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:54:52.817346 18994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:52.818616 18975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:54:52.818816 18975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "27eecae8434346188d38ad96df45af6f"
format_stamp: "Formatted at 2026-08-09 22:54:52 on dist-test-slave-92m1"
server_key: "c2ed625ad82c4e590e5ac60058ecfab0"
server_key_iv: "ae01bc22d9200a41f302cc68959b02c5"
server_key_version: "encryptionkey@0"
I20260809 22:54:52.819025 18975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:52.834910 18975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:52.839911 18975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:52.840270 18975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:52.860065 18975 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:33563
I20260809 22:54:52.860085 19073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:33563 every 8 connection(s)
I20260809 22:54:52.861490 18975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:54:52.866112 19074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:52.867914 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 18975
I20260809 22:54:52.868144 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:54:52.868799 24077 external_mini_cluster.cc:1428] Setting key e8c74870f20664732470ec2a72c6d09a
I20260809 22:54:52.878367 19074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f: Bootstrap starting.
I20260809 22:54:52.882282 19074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:52.883687 19074 log.cc:824] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:54:52 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:52.886665 19074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f: No bootstrap required, opened a new log
I20260809 22:54:52.893281 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:52.870860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45522 (local address 127.23.131.126:33563)
0809 22:54:52.871748 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:52.871762 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:52.871807 (+ 45us) server_negotiation.cc:407] Connection header received
0809 22:54:52.873527 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:52.873551 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:52.873913 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:52.874226 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:52.876263 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:52.877618 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:52.879450 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:52.880117 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:52.880246 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:52.885423 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:52.885430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:52.885444 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:52.885477 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:52.888670 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:52.889515 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:52.889521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:52.889527 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:52.889703 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:52.890089 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:52.890092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:52.890094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:52.890611 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:52.890823 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:52.891390 (+ 567us) server_negotiation.cc:299] Negotiation successful
0809 22:54:52.891797 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":434,"threads_started":1}
I20260809 22:54:52.896577 19074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eecae8434346188d38ad96df45af6f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33563 } }
I20260809 22:54:52.896936 19074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:52.897050 19074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27eecae8434346188d38ad96df45af6f, State: Initialized, Role: FOLLOWER
I20260809 22:54:52.897621 19074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eecae8434346188d38ad96df45af6f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33563 } }
I20260809 22:54:52.897894 19074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:54:52.898106 19074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:54:52.898310 19074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:52.900743 19074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eecae8434346188d38ad96df45af6f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33563 } }
I20260809 22:54:52.901238 19074 leader_election.cc:302] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27eecae8434346188d38ad96df45af6f; no voters:
I20260809 22:54:52.901811 19074 leader_election.cc:288] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:54:52.901942 19080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:54:52.902704 19080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [term 1 LEADER]: Becoming Leader. State: Replica: 27eecae8434346188d38ad96df45af6f, State: Running, Role: LEADER
I20260809 22:54:52.903313 19080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eecae8434346188d38ad96df45af6f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33563 } }
I20260809 22:54:52.903991 19074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:54:52.906201 19082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27eecae8434346188d38ad96df45af6f. Latest consensus state: current_term: 1 leader_uuid: "27eecae8434346188d38ad96df45af6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eecae8434346188d38ad96df45af6f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33563 } } }
I20260809 22:54:52.906319 19081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27eecae8434346188d38ad96df45af6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27eecae8434346188d38ad96df45af6f" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33563 } } }
I20260809 22:54:52.906821 19082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:52.906951 19081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:52.908035 19090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:54:52.913722 19090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:54:52.922482 19090 catalog_manager.cc:1347] Generated new cluster ID: 9acfc42c3aec48df9db26ca7608e8a13
I20260809 22:54:52.922631 19090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:54:52.938285 19090 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:54:52.940339 19090 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:54:52.948612 19090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f: Generated new TSK 0
I20260809 22:54:52.949481 19090 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:54:53.046851 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:33563
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:53.403947 19106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:53.404286 19106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:53.404420 19106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:53.411813 19106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:53.411921 19106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:53.412036 19106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:54:53.421737 19106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:33563
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:53.423091 19106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:53.424463 19106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:53.437727 19113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:53.437704 19117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:53.437897 19114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:53.438670 19106 server_base.cc:1034] running on GCE node
I20260809 22:54:53.439345 19106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:53.440253 19106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:53.441480 19106 hybrid_clock.cc:648] HybridClock initialized: now 1786316093441419 us; error 54 us; skew 500 ppm
I20260809 22:54:53.441807 19106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:53 dist-test-slave-92m1 krb5kdc[18956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316093, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:53.445139 19106 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:54:53.446643 19106 webserver.cc:460] Webserver started at http://127.23.131.65:40523/ using document root <none> and password file <none>
I20260809 22:54:53.447440 19106 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:53.447595 19106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:53.447923 19106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:53.451058 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "7396f5006e524eebafddae2978f932c6"
format_stamp: "Formatted at 2026-08-09 22:54:53 on dist-test-slave-92m1"
server_key: "31a8b84e8fc51020378431c1cb682ea4"
server_key_iv: "6f918e69537893ba169817e58bc44075"
server_key_version: "encryptionkey@0"
I20260809 22:54:53.451906 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "7396f5006e524eebafddae2978f932c6"
format_stamp: "Formatted at 2026-08-09 22:54:53 on dist-test-slave-92m1"
server_key: "31a8b84e8fc51020378431c1cb682ea4"
server_key_iv: "6f918e69537893ba169817e58bc44075"
server_key_version: "encryptionkey@0"
I20260809 22:54:53.458787 19106 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 22:54:53.462443 19131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:53.463842 19106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:54:53.464041 19106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "7396f5006e524eebafddae2978f932c6"
format_stamp: "Formatted at 2026-08-09 22:54:53 on dist-test-slave-92m1"
server_key: "31a8b84e8fc51020378431c1cb682ea4"
server_key_iv: "6f918e69537893ba169817e58bc44075"
server_key_version: "encryptionkey@0"
I20260809 22:54:53.464260 19106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:53.478523 19106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:53.482802 19106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:53.483127 19106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:53.484170 19106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:53.485625 19106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:53.485738 19106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:53.485903 19106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:53.485982 19106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:53.520684 19106 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:42389
I20260809 22:54:53.520731 19297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:42389 every 8 connection(s)
I20260809 22:54:53.522161 19106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:54:53.524068 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 19106
I20260809 22:54:53.524307 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:54:53.525169 24077 external_mini_cluster.cc:1428] Setting key 1b829264a5ef3a0a1dae1bebe142048e
Aug 09 22:54:53 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316093, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:53.545291 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:53.524852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:45315 (local address 127.23.131.126:33563)
0809 22:54:53.525411 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:53.525418 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:53.526426 (+ 1008us) server_negotiation.cc:407] Connection header received
0809 22:54:53.528351 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:53.528359 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:53.528451 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:53.528572 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:53.530021 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:53.531184 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:53.532749 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:53.533449 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:53.533603 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:53.537112 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:53.537121 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:53.537129 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:53.537174 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:53.540772 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:53.541829 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:53.541837 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:53.541871 (+ 34us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:53.542126 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:53.542702 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:53.542709 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:53.542715 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:53.543321 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:53.543527 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:53.544552 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0809 22:54:53.544893 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":292,"threads_started":1}
I20260809 22:54:53.546473 19303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:53.525388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:33563 (local address 127.23.131.65:45315)
0809 22:54:53.526254 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:53.526308 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:53.528083 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:53.528767 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:53.528774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:53.529291 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:53.529838 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:53.529855 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:53.531356 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:53.531359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:53.532586 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:53.532598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:53.533663 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:53.533668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:53.533863 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:53.534573 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:54:53.534595 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:53.536878 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:53.540956 (+ 4078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:53.540968 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:53.540988 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:53.541694 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:53.542264 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:53.542271 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:53.542276 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:53.542556 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:53.543471 (+ 915us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:53.543482 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:53.543994 (+ 512us) client_negotiation.cc:769] Sending connection context
0809 22:54:53.544347 (+ 353us) client_negotiation.cc:240] Negotiation successful
0809 22:54:53.544932 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":350,"threads_started":1}
I20260809 22:54:53.548424 19299 heartbeater.cc:347] Connected to a master server at 127.23.131.126:33563
I20260809 22:54:53.548760 19299 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:53.549727 19299 heartbeater.cc:511] Master 127.23.131.126:33563 requested a full tablet report, sending...
I20260809 22:54:53.552102 19022 ts_manager.cc:194] Registered new tserver with Master: 7396f5006e524eebafddae2978f932c6 (127.23.131.65:42389)
I20260809 22:54:53.553587 19022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:45315
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:54:53.608798 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:33563
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:53.973671 19306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:53.974043 19306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:53.974231 19306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:53.981933 19306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:53.982170 19306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:53.982407 19306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:54:53.992743 19306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:33563
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:53.993989 19306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:53.995371 19306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:54.009473 19312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:54.009533 19316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:54.009614 19313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:54.010924 19306 server_base.cc:1034] running on GCE node
I20260809 22:54:54.011669 19306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:54.012704 19306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:54.013947 19306 hybrid_clock.cc:648] HybridClock initialized: now 1786316094013901 us; error 38 us; skew 500 ppm
I20260809 22:54:54.014287 19306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:54 dist-test-slave-92m1 krb5kdc[18956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316094, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:54.017598 19306 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:54:54.019193 19306 webserver.cc:460] Webserver started at http://127.23.131.66:39391/ using document root <none> and password file <none>
I20260809 22:54:54.019965 19306 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:54.020125 19306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:54.020466 19306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:54.023694 19306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "4eee00254d0a4569b4b24f493a1d20bd"
format_stamp: "Formatted at 2026-08-09 22:54:54 on dist-test-slave-92m1"
server_key: "5a11b60ff92d8a72c7b0c6da32e9c78c"
server_key_iv: "ca6c5deea293dbf350c73344b4b33996"
server_key_version: "encryptionkey@0"
I20260809 22:54:54.024523 19306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "4eee00254d0a4569b4b24f493a1d20bd"
format_stamp: "Formatted at 2026-08-09 22:54:54 on dist-test-slave-92m1"
server_key: "5a11b60ff92d8a72c7b0c6da32e9c78c"
server_key_iv: "ca6c5deea293dbf350c73344b4b33996"
server_key_version: "encryptionkey@0"
I20260809 22:54:54.029816 19306 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 22:54:54.033402 19326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:54.034651 19306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:54:54.034827 19306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "4eee00254d0a4569b4b24f493a1d20bd"
format_stamp: "Formatted at 2026-08-09 22:54:54 on dist-test-slave-92m1"
server_key: "5a11b60ff92d8a72c7b0c6da32e9c78c"
server_key_iv: "ca6c5deea293dbf350c73344b4b33996"
server_key_version: "encryptionkey@0"
I20260809 22:54:54.035027 19306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:54.059377 19306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:54.063978 19306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:54.064291 19306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:54.065330 19306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:54.066754 19306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:54.066864 19306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:54.067016 19306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:54.067093 19306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:54.102612 19306 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:33879
I20260809 22:54:54.102653 19502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:33879 every 8 connection(s)
I20260809 22:54:54.104238 19306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:54:54.105990 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 19306
I20260809 22:54:54.106189 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:54:54.106809 24077 external_mini_cluster.cc:1428] Setting key 703b9c25d307a058ed9aecf018c3eda6
Aug 09 22:54:54 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316094, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:54.130129 19505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.107173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:50407 (local address 127.23.131.126:33563)
0809 22:54:54.107835 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:54.107842 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:54.109001 (+ 1159us) server_negotiation.cc:407] Connection header received
0809 22:54:54.113263 (+ 4262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:54.113271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:54.113367 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:54.113490 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:54.115000 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.116199 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.117797 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.118527 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.118675 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.122490 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:54.122500 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:54.122509 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:54.122556 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:54.126309 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:54.127358 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:54.127362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:54.127364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:54.127499 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:54.127997 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:54.128005 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:54.128010 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:54.128425 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:54.128581 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:54.129340 (+ 759us) server_negotiation.cc:299] Negotiation successful
0809 22:54:54.129608 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":355,"threads_started":1}
I20260809 22:54:54.130798 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.107857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:33563 (local address 127.23.131.66:50407)
0809 22:54:54.108826 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:54.108885 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:54.112968 (+ 4083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:54.113688 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:54.113696 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:54.114237 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:54.114819 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.114836 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.116385 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.116389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.117642 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.117654 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.118746 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.118751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.118945 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.119719 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:54:54.119742 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:54.122253 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:54.126462 (+ 4209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:54.126473 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:54.126492 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:54.127234 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:54.127622 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:54.127626 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:54.127628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:54.127868 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:54.128565 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:54.128572 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:54.128908 (+ 336us) client_negotiation.cc:769] Sending connection context
0809 22:54:54.129179 (+ 271us) client_negotiation.cc:240] Negotiation successful
0809 22:54:54.129597 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":388,"threads_started":1}
I20260809 22:54:54.132362 19503 heartbeater.cc:347] Connected to a master server at 127.23.131.126:33563
I20260809 22:54:54.132710 19503 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:54.133462 19503 heartbeater.cc:511] Master 127.23.131.126:33563 requested a full tablet report, sending...
I20260809 22:54:54.134979 19022 ts_manager.cc:194] Registered new tserver with Master: 4eee00254d0a4569b4b24f493a1d20bd (127.23.131.66:33879)
I20260809 22:54:54.135875 19022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:50407
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:54:54.190166 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:33563
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:54:54.545943 19514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:54.546263 19514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:54.546440 19514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:54.553634 19514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:54.553797 19514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:54.553974 19514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:54:54.557322 19299 heartbeater.cc:503] Master 127.23.131.126:33563 was elected leader, sending a full tablet report...
I20260809 22:54:54.564244 19514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:33563
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:54.565448 19514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:54.566773 19514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:54.580267 19522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:54.580317 19520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:54.580436 19525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:54.581562 19514 server_base.cc:1034] running on GCE node
I20260809 22:54:54.582242 19514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:54.583284 19514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:54.584506 19514 hybrid_clock.cc:648] HybridClock initialized: now 1786316094584467 us; error 39 us; skew 500 ppm
I20260809 22:54:54.584839 19514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:54:54 dist-test-slave-92m1 krb5kdc[18956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316094, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:54:54.588275 19514 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:54:54.589884 19514 webserver.cc:460] Webserver started at http://127.23.131.67:37257/ using document root <none> and password file <none>
I20260809 22:54:54.590600 19514 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:54.590741 19514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:54.591077 19514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:54.594101 19514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "592737aff57b40389b1feafbbf62c50f"
format_stamp: "Formatted at 2026-08-09 22:54:54 on dist-test-slave-92m1"
server_key: "fec012e73e8871450f23d0695ef0e573"
server_key_iv: "2cb0db056fd049135ffe6f2c2ff4a545"
server_key_version: "encryptionkey@0"
I20260809 22:54:54.594931 19514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "592737aff57b40389b1feafbbf62c50f"
format_stamp: "Formatted at 2026-08-09 22:54:54 on dist-test-slave-92m1"
server_key: "fec012e73e8871450f23d0695ef0e573"
server_key_iv: "2cb0db056fd049135ffe6f2c2ff4a545"
server_key_version: "encryptionkey@0"
I20260809 22:54:54.600517 19514 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 22:54:54.604063 19536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:54.605597 19514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:54:54.605779 19514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "592737aff57b40389b1feafbbf62c50f"
format_stamp: "Formatted at 2026-08-09 22:54:54 on dist-test-slave-92m1"
server_key: "fec012e73e8871450f23d0695ef0e573"
server_key_iv: "2cb0db056fd049135ffe6f2c2ff4a545"
server_key_version: "encryptionkey@0"
I20260809 22:54:54.605988 19514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:54.622433 19514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:54.626688 19514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:54.626935 19514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:54.627959 19514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:54.629348 19514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:54.629426 19514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:54.629515 19514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:54.629560 19514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:54.663559 19514 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:34789
I20260809 22:54:54.663619 19707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:34789 every 8 connection(s)
I20260809 22:54:54.664901 19514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:54:54.667980 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 19514
I20260809 22:54:54.668186 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:54:54.668771 24077 external_mini_cluster.cc:1428] Setting key d4ea38cd14a25b6f2509fa4374dacf59
Aug 09 22:54:54 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316094, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:54:54.685715 19713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.667631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:38693 (local address 127.23.131.126:33563)
0809 22:54:54.668204 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:54.668211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:54.671288 (+ 3077us) server_negotiation.cc:407] Connection header received
0809 22:54:54.671510 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:54.671514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:54.671598 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:54.671740 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:54.673302 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.674102 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.675692 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.676098 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.676196 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.679590 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:54.679595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:54.679599 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:54.679632 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:54.682392 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:54.683256 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:54.683266 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:54.683268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:54.683450 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:54.684019 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:54.684024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:54.684026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:54.684372 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:54.684535 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:54.685242 (+ 707us) server_negotiation.cc:299] Negotiation successful
0809 22:54:54.685413 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":256,"threads_started":1}
I20260809 22:54:54.686616 19716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.668279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:33563 (local address 127.23.131.67:38693)
0809 22:54:54.669161 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:54.669218 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:54.671211 (+ 1993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:54.672014 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:54.672024 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:54.672583 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:54.673151 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.673168 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.674237 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.674241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.675567 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.675579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.676287 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.676292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.676488 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.677142 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:54:54.677166 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:54.679401 (+ 2235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:54.682549 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:54.682556 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:54.682569 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:54.683087 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:54.683608 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:54:54.683614 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:54:54.683617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:54:54.683880 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:54:54.684547 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:54.684555 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:54.684892 (+ 337us) client_negotiation.cc:769] Sending connection context
0809 22:54:54.685136 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 22:54:54.685518 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":372,"threads_started":1}
I20260809 22:54:54.687992 19709 heartbeater.cc:347] Connected to a master server at 127.23.131.126:33563
I20260809 22:54:54.688261 19709 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:54.688948 19709 heartbeater.cc:511] Master 127.23.131.126:33563 requested a full tablet report, sending...
I20260809 22:54:54.690354 19022 ts_manager.cc:194] Registered new tserver with Master: 592737aff57b40389b1feafbbf62c50f (127.23.131.67:34789)
I20260809 22:54:54.691185 19022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:38693
I20260809 22:54:54.696812 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:54:54.715428 19713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.701753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48802 (local address 127.23.131.126:33563)
0809 22:54:54.701936 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:54.701941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:54.702520 (+ 579us) server_negotiation.cc:407] Connection header received
0809 22:54:54.702625 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:54.702629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:54.702701 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:54.702796 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:54.704511 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.705318 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.706719 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.707126 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.707283 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.710079 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:54.710085 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:54.710088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:54.710122 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:54.712977 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:54.713624 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:54.713628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:54.713630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:54.713750 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:54.714102 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:54.714105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:54.714107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:54.714432 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:54.714619 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:54.714933 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 22:54:54.715112 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 22:54:54.719640 19022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:54:54.726652 19022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:54:54.756145 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.739224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:34789 (local address 127.0.0.1:43750)
0809 22:54:54.744248 (+ 5024us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:54.744291 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:54.744507 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:54.745906 (+ 1399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:54.745917 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:54.745960 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:54.746443 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.746459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.749148 (+ 2689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.749156 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.752404 (+ 3248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.752425 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.754999 (+ 2574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.755006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.755291 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.755351 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 22:54:54.755453 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:54:54.755720 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4770,"thread_start_us":11342,"threads_started":1}
I20260809 22:54:54.756356 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.739516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43750 (local address 127.23.131.67:34789)
0809 22:54:54.740566 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:54.740579 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:54.744428 (+ 3849us) server_negotiation.cc:407] Connection header received
0809 22:54:54.744884 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:54.744895 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:54.745206 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:54.745413 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:54.746734 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.748903 (+ 2169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.752635 (+ 3732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.754759 (+ 2124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.755667 (+ 908us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.755846 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:54.755905 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 22:54:54.756032 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":823,"threads_started":1}
I20260809 22:54:54.760829 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.739492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37018)
0809 22:54:54.750285 (+ 10793us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:54.750310 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:54.750468 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:54.752703 (+ 2235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:54.752711 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:54.752749 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:54.753302 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.753317 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.755468 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.755473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.757891 (+ 2418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.757905 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.759898 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.759905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.760139 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.760179 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 22:54:54.760273 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 22:54:54.760415 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10598,"mutex_wait_us":21,"thread_start_us":4361,"threads_started":1}
I20260809 22:54:54.761294 19605 tablet_service.cc:1467] Processing CreateTablet for tablet f31623cee2174f7481c72aa73f171342 (DEFAULT_TABLE table=test-table [id=8c74faaf45624b9793125582948e26e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:54.761999 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.740074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.23.131.65:42389)
0809 22:54:54.743846 (+ 3772us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:54.743857 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:54.750839 (+ 6982us) server_negotiation.cc:407] Connection header received
0809 22:54:54.750940 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:54.750949 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:54.751184 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:54.751400 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:54.753510 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.755051 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.758084 (+ 3033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.759655 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.761178 (+ 1523us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.761411 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:54.761514 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 22:54:54.761704 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3547,"thread_start_us":3359,"threads_started":1}
I20260809 22:54:54.763904 19605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31623cee2174f7481c72aa73f171342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:54.764259 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.744729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:33879 (local address 127.0.0.1:36452)
0809 22:54:54.754506 (+ 9777us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:54.754524 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:54.754647 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:54.755397 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:54.755401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:54.755425 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:54.756901 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.756913 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.759282 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.759287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.761492 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:54.761506 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.763394 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.763405 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:54.763588 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.763625 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 22:54:54.763725 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 22:54:54.763858 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9645,"mutex_wait_us":1092,"thread_start_us":9498,"threads_started":1}
I20260809 22:54:54.764559 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:54.745025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36452 (local address 127.23.131.66:33879)
0809 22:54:54.754023 (+ 8998us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:54.754036 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:54.754782 (+ 746us) server_negotiation.cc:407] Connection header received
0809 22:54:54.754906 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:54.754915 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:54.755154 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:54.755377 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:54.757190 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.759107 (+ 1917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.761662 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:54.763131 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:54.763344 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:54.763557 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:54.764044 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 22:54:54.764230 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8771,"thread_start_us":10109,"threads_started":1}
I20260809 22:54:54.766054 19198 tablet_service.cc:1467] Processing CreateTablet for tablet f31623cee2174f7481c72aa73f171342 (DEFAULT_TABLE table=test-table [id=8c74faaf45624b9793125582948e26e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:54.767630 19198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31623cee2174f7481c72aa73f171342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:54.768195 19404 tablet_service.cc:1467] Processing CreateTablet for tablet f31623cee2174f7481c72aa73f171342 (DEFAULT_TABLE table=test-table [id=8c74faaf45624b9793125582948e26e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:54.769579 19404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31623cee2174f7481c72aa73f171342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:54.777237 19736 tablet_bootstrap.cc:492] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Bootstrap starting.
I20260809 22:54:54.780596 19736 tablet_bootstrap.cc:654] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:54.781708 19736 log.cc:824] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:54.784472 19738 tablet_bootstrap.cc:492] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Bootstrap starting.
I20260809 22:54:54.786180 19740 tablet_bootstrap.cc:492] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Bootstrap starting.
I20260809 22:54:54.787819 19736 tablet_bootstrap.cc:492] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: No bootstrap required, opened a new log
I20260809 22:54:54.788107 19736 ts_tablet_manager.cc:1397] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260809 22:54:54.789357 19738 tablet_bootstrap.cc:654] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:54.789515 19740 tablet_bootstrap.cc:654] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:54.790584 19740 log.cc:824] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:54.790709 19738 log.cc:824] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:54.793715 19740 tablet_bootstrap.cc:492] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: No bootstrap required, opened a new log
I20260809 22:54:54.794041 19740 ts_tablet_manager.cc:1397] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260809 22:54:54.798043 19738 tablet_bootstrap.cc:492] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: No bootstrap required, opened a new log
I20260809 22:54:54.798472 19738 ts_tablet_manager.cc:1397] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260809 22:54:54.800848 19736 raft_consensus.cc:348] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:54.801339 19736 raft_consensus.cc:374] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:54.801501 19736 raft_consensus.cc:729] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 592737aff57b40389b1feafbbf62c50f, State: Initialized, Role: FOLLOWER
I20260809 22:54:54.802193 19736 consensus_queue.cc:260] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:54.802292 19740 raft_consensus.cc:348] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:54.802815 19740 raft_consensus.cc:374] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:54.802980 19740 raft_consensus.cc:729] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eee00254d0a4569b4b24f493a1d20bd, State: Initialized, Role: FOLLOWER
I20260809 22:54:54.803658 19740 consensus_queue.cc:260] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:54.805125 19503 heartbeater.cc:503] Master 127.23.131.126:33563 was elected leader, sending a full tablet report...
I20260809 22:54:54.805495 19740 ts_tablet_manager.cc:1428] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260809 22:54:54.808655 19736 ts_tablet_manager.cc:1428] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Time spent starting tablet: real 0.020s user 0.009s sys 0.008s
I20260809 22:54:54.809115 19709 heartbeater.cc:503] Master 127.23.131.126:33563 was elected leader, sending a full tablet report...
I20260809 22:54:54.810135 19738 raft_consensus.cc:348] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:54.810662 19738 raft_consensus.cc:374] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:54.810827 19738 raft_consensus.cc:729] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7396f5006e524eebafddae2978f932c6, State: Initialized, Role: FOLLOWER
I20260809 22:54:54.811491 19738 consensus_queue.cc:260] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:54.813582 19738 ts_tablet_manager.cc:1428] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
W20260809 22:54:54.856527 19504 tablet.cc:2369] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:54:54.916785 19712 tablet.cc:2369] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:54:55.025064 19300 tablet.cc:2369] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:54:55.069363 19745 raft_consensus.cc:482] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:54:55.069733 19745 raft_consensus.cc:504] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:55.071576 19745 leader_election.cc:288] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 592737aff57b40389b1feafbbf62c50f (127.23.131.67:34789), 4eee00254d0a4569b4b24f493a1d20bd (127.23.131.66:33879)
I20260809 22:54:55.078953 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.072039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:46661 (local address 127.23.131.67:34789)
0809 22:54:55.072254 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:55.072263 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:55.073215 (+ 952us) server_negotiation.cc:407] Connection header received
0809 22:54:55.073388 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:55.073395 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:55.073483 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:55.073591 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:55.074261 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.075117 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.077009 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.077863 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.077995 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.078103 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:55.078554 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 22:54:55.078682 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:54:55.078955 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.072123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:54301 (local address 127.23.131.66:33879)
0809 22:54:55.072338 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:55.072346 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:55.073447 (+ 1101us) server_negotiation.cc:407] Connection header received
0809 22:54:55.073612 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:55.073616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:55.073698 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:55.073805 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:55.074473 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.075270 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.077129 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.077909 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.078101 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.078171 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:55.078550 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 22:54:55.078682 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 22:54:55.079135 19746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.072033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:34789 (local address 127.23.131.65:46661)
0809 22:54:55.073091 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.073108 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:55.073241 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:55.073626 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:55.073631 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:55.073664 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:55.074094 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:55.074106 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.075293 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.075300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:55.076845 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:55.076857 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.078128 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.078135 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:55.078365 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.078397 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:54:55.078501 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 22:54:55.078643 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":46,"thread_start_us":481,"threads_started":1}
I20260809 22:54:55.079186 19749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.072189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:33879 (local address 127.23.131.65:54301)
0809 22:54:55.073324 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.073341 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:55.073472 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:55.073837 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:55.073840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:55.073863 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:55.074283 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:55.074295 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.075422 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.075426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:55.076949 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:55.076965 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.078188 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.078193 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:55.078362 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.078394 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:54:55.078501 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 22:54:55.078660 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":991,"mutex_wait_us":48,"thread_start_us":674,"threads_started":1}
I20260809 22:54:55.080242 19639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31623cee2174f7481c72aa73f171342" candidate_uuid: "7396f5006e524eebafddae2978f932c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "592737aff57b40389b1feafbbf62c50f" is_pre_election: true
I20260809 22:54:55.080296 19438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31623cee2174f7481c72aa73f171342" candidate_uuid: "7396f5006e524eebafddae2978f932c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eee00254d0a4569b4b24f493a1d20bd" is_pre_election: true
I20260809 22:54:55.080790 19639 raft_consensus.cc:2454] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7396f5006e524eebafddae2978f932c6 in term 0.
I20260809 22:54:55.080775 19438 raft_consensus.cc:2454] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7396f5006e524eebafddae2978f932c6 in term 0.
I20260809 22:54:55.081501 19137 leader_election.cc:302] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4eee00254d0a4569b4b24f493a1d20bd, 592737aff57b40389b1feafbbf62c50f, 7396f5006e524eebafddae2978f932c6; no voters:
I20260809 22:54:55.081938 19745 raft_consensus.cc:2781] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:54:55.082103 19745 raft_consensus.cc:482] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:54:55.082224 19745 raft_consensus.cc:3037] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:55.084614 19745 raft_consensus.cc:504] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:55.085237 19745 leader_election.cc:288] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [CANDIDATE]: Term 1 election: Requested vote from peers 592737aff57b40389b1feafbbf62c50f (127.23.131.67:34789), 4eee00254d0a4569b4b24f493a1d20bd (127.23.131.66:33879)
I20260809 22:54:55.085737 19438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31623cee2174f7481c72aa73f171342" candidate_uuid: "7396f5006e524eebafddae2978f932c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eee00254d0a4569b4b24f493a1d20bd"
I20260809 22:54:55.085744 19639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31623cee2174f7481c72aa73f171342" candidate_uuid: "7396f5006e524eebafddae2978f932c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "592737aff57b40389b1feafbbf62c50f"
I20260809 22:54:55.085943 19438 raft_consensus.cc:3037] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:55.085958 19639 raft_consensus.cc:3037] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:55.088231 19438 raft_consensus.cc:2454] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7396f5006e524eebafddae2978f932c6 in term 1.
I20260809 22:54:55.088244 19639 raft_consensus.cc:2454] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7396f5006e524eebafddae2978f932c6 in term 1.
I20260809 22:54:55.088670 19137 leader_election.cc:302] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eee00254d0a4569b4b24f493a1d20bd, 7396f5006e524eebafddae2978f932c6; no voters:
I20260809 22:54:55.088971 19745 raft_consensus.cc:2781] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:54:55.089419 19745 raft_consensus.cc:686] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7396f5006e524eebafddae2978f932c6, State: Running, Role: LEADER
I20260809 22:54:55.089986 19745 consensus_queue.cc:237] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } }
I20260809 22:54:55.094626 19022 catalog_manager.cc:5495] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7396f5006e524eebafddae2978f932c6 (127.23.131.65). New cstate: current_term: 1 leader_uuid: "7396f5006e524eebafddae2978f932c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7396f5006e524eebafddae2978f932c6" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 } health_report { overall_health: UNKNOWN } } }
I20260809 22:54:55.131409 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.126111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.23.131.65:42389)
0809 22:54:55.126371 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:55.126376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:55.126394 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:54:55.126572 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:55.126576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:55.126679 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:55.126797 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:54:55.127161 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.127971 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.129391 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.129780 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.129870 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.130319 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:54:55.130821 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:54:55.130925 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:55.131026 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 22:54:55.131090 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 22:54:55.139706 19438 raft_consensus.cc:1261] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 1 FOLLOWER]: Refusing update from remote peer 7396f5006e524eebafddae2978f932c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:54:55.139760 19639 raft_consensus.cc:1261] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 1 FOLLOWER]: Refusing update from remote peer 7396f5006e524eebafddae2978f932c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:54:55.140734 19745 consensus_queue.cc:1035] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "592737aff57b40389b1feafbbf62c50f" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:54:55.141083 19753 consensus_queue.cc:1035] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eee00254d0a4569b4b24f493a1d20bd" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 33879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:54:55.169376 19022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:54:55.169672 19022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:54:55.173606 19022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 27eecae8434346188d38ad96df45af6f: Sending DeleteTablet for 3 replicas of tablet f31623cee2174f7481c72aa73f171342
I20260809 22:54:55.174867 19605 tablet_service.cc:1514] Processing DeleteTablet for tablet f31623cee2174f7481c72aa73f171342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:55 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:43750
I20260809 22:54:55.174964 19198 tablet_service.cc:1514] Processing DeleteTablet for tablet f31623cee2174f7481c72aa73f171342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:55 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:37018
I20260809 22:54:55.175132 19404 tablet_service.cc:1514] Processing DeleteTablet for tablet f31623cee2174f7481c72aa73f171342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:55 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:36452
I20260809 22:54:55.182410 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 19106
I20260809 22:54:55.187680 19775 tablet_replica.cc:330] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: stopping tablet replica
I20260809 22:54:55.188176 19775 raft_consensus.cc:2229] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:54:55.188743 19775 raft_consensus.cc:2258] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:55.189512 19776 tablet_replica.cc:330] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: stopping tablet replica
I20260809 22:54:55.189954 19776 raft_consensus.cc:2229] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:54:55.190692 19776 raft_consensus.cc:2258] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:55.191816 19777 tablet_replica.cc:330] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: stopping tablet replica
I20260809 22:54:55.192337 19777 raft_consensus.cc:2229] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:54:55.192948 19777 raft_consensus.cc:2258] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:55.193203 19775 ts_tablet_manager.cc:1905] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:55.196885 19776 ts_tablet_manager.cc:1905] T f31623cee2174f7481c72aa73f171342 P 7396f5006e524eebafddae2978f932c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:55.195164 19777 ts_tablet_manager.cc:1905] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 22:54:55 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:54:55.201103 19775 ts_tablet_manager.cc:1918] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:55.201423 19775 log.cc:1196] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/f31623cee2174f7481c72aa73f171342
I20260809 22:54:55.202117 19775 ts_tablet_manager.cc:1939] T f31623cee2174f7481c72aa73f171342 P 592737aff57b40389b1feafbbf62c50f: Deleting consensus metadata
I20260809 22:54:55.204260 18995 catalog_manager.cc:4841] TS 592737aff57b40389b1feafbbf62c50f (127.23.131.67:34789): tablet f31623cee2174f7481c72aa73f171342 (table test-table [id=8c74faaf45624b9793125582948e26e8]) successfully deleted
I20260809 22:54:55.206120 19777 ts_tablet_manager.cc:1918] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:55.206375 19777 log.cc:1196] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/f31623cee2174f7481c72aa73f171342
I20260809 22:54:55.207046 19777 ts_tablet_manager.cc:1939] T f31623cee2174f7481c72aa73f171342 P 4eee00254d0a4569b4b24f493a1d20bd: Deleting consensus metadata
I20260809 22:54:55.209102 18997 catalog_manager.cc:4841] TS 4eee00254d0a4569b4b24f493a1d20bd (127.23.131.66:33879): tablet f31623cee2174f7481c72aa73f171342 (table test-table [id=8c74faaf45624b9793125582948e26e8]) successfully deleted
I20260809 22:54:55.209215 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.184865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37030 (local address 127.23.131.65:42389)
0809 22:54:55.185076 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:55.185082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:55.186286 (+ 1204us) server_negotiation.cc:407] Connection header received
0809 22:54:55.187267 (+ 981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:55.187275 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:55.187381 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:55.187458 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:55.189961 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.191321 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.193247 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.193944 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.194046 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.199939 (+ 5893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:55.199955 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:55.199971 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:55.200017 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:55.204428 (+ 4411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:55.205225 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:55.205234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:55.205242 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:55.205864 (+ 622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:55.206404 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:55.206410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:55.206413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:55.206945 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:55.207287 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:55.208522 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0809 22:54:55.208808 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 22:54:55.210005 19290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:55.312743 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 19106
I20260809 22:54:55.340070 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 19306
W20260809 22:54:55.340080 18997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:42389 (error 108)
I20260809 22:54:55.342269 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.341486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37044)
0809 22:54:55.341993 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.342102 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":244,"threads_started":1}
W20260809 22:54:55.342506 18997 catalog_manager.cc:4584] TS 7396f5006e524eebafddae2978f932c6 (127.23.131.65:42389): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f31623cee2174f7481c72aa73f171342: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Aug 09 22:54:55 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:54:55.356702 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.340952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36456 (local address 127.23.131.66:33879)
0809 22:54:55.341294 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:55.341299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:55.341318 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:54:55.341539 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:55.341543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:55.341620 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:55.341739 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:55.343309 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.344100 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.345453 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.345868 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.346023 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.350829 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:55.350846 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:55.350862 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:55.350907 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:55.353691 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:55.354413 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:55.354421 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:55.354423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:55.354559 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:55.354957 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:55.354963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:55.354966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:55.355447 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:55.355767 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:55.356114 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 22:54:55.356336 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260809 22:54:55.357394 19497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:55.396181 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.395679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37060)
0809 22:54:55.395891 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.396027 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 22:54:55.397378 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.396951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37064)
0809 22:54:55.397141 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.397220 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 22:54:55.450958 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 19306
I20260809 22:54:55.458189 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.457721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37068)
0809 22:54:55.457944 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.458036 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 22:54:55.459461 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.459053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37070)
0809 22:54:55.459194 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.459319 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 22:54:55.479429 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 19514
Aug 09 22:54:55 dist-test-slave-92m1 krb5kdc[18956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:54:55.494508 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.480256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43764 (local address 127.23.131.67:34789)
0809 22:54:55.480495 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:55.480502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:55.480536 (+ 34us) server_negotiation.cc:407] Connection header received
0809 22:54:55.480710 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:55.480716 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:55.480780 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:55.480890 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:55.482254 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.482989 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.484411 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:55.484823 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:55.484956 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:55.489450 (+ 4494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:55.489465 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:55.489481 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:54:55.489530 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:55.492179 (+ 2649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:55.492804 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:55.492810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:55.492812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:55.492940 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:54:55.493268 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:54:55.493271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:54:55.493273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:54:55.493633 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:55.493863 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:55.494091 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 22:54:55.494253 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 22:54:55.495270 19703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:55.539937 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.539415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37072)
0809 22:54:55.539667 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.539768 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 22:54:55.544800 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.544107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37080)
0809 22:54:55.544451 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.544577 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 22:54:55.589074 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 19514
I20260809 22:54:55.620682 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 18975
I20260809 22:54:55.622007 19067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:55.735879 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:55.735101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42389 (local address 127.0.0.1:37090)
0809 22:54:55.735337 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:55.735643 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 22:54:55.736068 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 18975
2026-08-09T22:54:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5117 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T22:54:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:54:55Z Disabled control of system clock
I20260809 22:54:55.858775 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40505
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:35977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:40505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 22:54:56.222028 19794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:56.222308 19794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:56.222470 19794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:56.229655 19794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:54:56.229756 19794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:56.229872 19794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:56.229977 19794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:54:56.230068 19794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:54:56.239148 19794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:35977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:40505
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:40505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:56.240461 19794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:56.242328 19794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:56.254614 19800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:56.254688 19802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:56.254585 19804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:56.255472 19794 server_base.cc:1034] running on GCE node
I20260809 22:54:56.256264 19794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:56.257638 19794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:56.258883 19794 hybrid_clock.cc:648] HybridClock initialized: now 1786316096258850 us; error 43 us; skew 500 ppm
I20260809 22:54:56.259289 19794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:54:56.261507 19794 webserver.cc:460] Webserver started at http://127.23.131.126:42311/ using document root <none> and password file <none>
I20260809 22:54:56.262180 19794 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:56.262316 19794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:56.262688 19794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:56.265712 19794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "5447fa525a494d70b4ab7bd43fc64d00"
format_stamp: "Formatted at 2026-08-09 22:54:56 on dist-test-slave-92m1"
server_key: "30ef30f5dd12d1cf92c09bc82731bc3e"
server_key_iv: "bf561249e9b9a3203cf5cf6ec49af1c9"
server_key_version: "encryptionkey@0"
I20260809 22:54:56.266539 19794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "5447fa525a494d70b4ab7bd43fc64d00"
format_stamp: "Formatted at 2026-08-09 22:54:56 on dist-test-slave-92m1"
server_key: "30ef30f5dd12d1cf92c09bc82731bc3e"
server_key_iv: "bf561249e9b9a3203cf5cf6ec49af1c9"
server_key_version: "encryptionkey@0"
I20260809 22:54:56.271668 19794 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:54:56.275169 19812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:56.276518 19794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:54:56.276706 19794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "5447fa525a494d70b4ab7bd43fc64d00"
format_stamp: "Formatted at 2026-08-09 22:54:56 on dist-test-slave-92m1"
server_key: "30ef30f5dd12d1cf92c09bc82731bc3e"
server_key_iv: "bf561249e9b9a3203cf5cf6ec49af1c9"
server_key_version: "encryptionkey@0"
I20260809 22:54:56.276932 19794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:56.290486 19794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:56.291417 19794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:56.291728 19794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:56.311540 19794 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:40505
I20260809 22:54:56.311561 19896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:40505 every 8 connection(s)
I20260809 22:54:56.312968 19794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:54:56.315289 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 19794
I20260809 22:54:56.315476 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:54:56.315970 24077 external_mini_cluster.cc:1428] Setting key 1ac51adff738fbe5b8eab1e20d1b9614
I20260809 22:54:56.317128 19897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:56.331825 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:56.318009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43270 (local address 127.23.131.126:40505)
0809 22:54:56.319145 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:56.319160 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:56.319233 (+ 73us) server_negotiation.cc:407] Connection header received
0809 22:54:56.321022 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:56.321051 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:56.321680 (+ 629us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:56.322141 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:56.322690 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:56.324843 (+ 2153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:56.326307 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:56.327376 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:56.327561 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:56.328794 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:56.328806 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:56.328826 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:56.329597 (+ 771us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:56.329705 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:56.329736 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:56.329852 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:56.330112 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 22:54:56.330475 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":381,"threads_started":1}
I20260809 22:54:56.333086 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00: Bootstrap starting.
I20260809 22:54:56.336310 19897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:56.337337 19897 log.cc:824] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:56.340452 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00: No bootstrap required, opened a new log
I20260809 22:54:56.348201 19897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5447fa525a494d70b4ab7bd43fc64d00" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40505 } }
I20260809 22:54:56.348594 19897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:56.348698 19897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5447fa525a494d70b4ab7bd43fc64d00, State: Initialized, Role: FOLLOWER
I20260809 22:54:56.349285 19897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5447fa525a494d70b4ab7bd43fc64d00" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40505 } }
I20260809 22:54:56.349524 19897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:54:56.349664 19897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:54:56.349838 19897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:56.352298 19897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5447fa525a494d70b4ab7bd43fc64d00" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40505 } }
I20260809 22:54:56.352834 19897 leader_election.cc:302] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5447fa525a494d70b4ab7bd43fc64d00; no voters:
I20260809 22:54:56.353473 19897 leader_election.cc:288] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:54:56.353654 19902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:54:56.354468 19902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [term 1 LEADER]: Becoming Leader. State: Replica: 5447fa525a494d70b4ab7bd43fc64d00, State: Running, Role: LEADER
I20260809 22:54:56.355039 19902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5447fa525a494d70b4ab7bd43fc64d00" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40505 } }
I20260809 22:54:56.355728 19897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:54:56.358266 19906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5447fa525a494d70b4ab7bd43fc64d00. Latest consensus state: current_term: 1 leader_uuid: "5447fa525a494d70b4ab7bd43fc64d00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5447fa525a494d70b4ab7bd43fc64d00" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40505 } } }
I20260809 22:54:56.358387 19904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5447fa525a494d70b4ab7bd43fc64d00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5447fa525a494d70b4ab7bd43fc64d00" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 40505 } } }
I20260809 22:54:56.358721 19906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:56.358794 19904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00 [sys.catalog]: This master's current role is: LEADER
I20260809 22:54:56.359804 19913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:54:56.366484 19913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:54:56.375053 19913 catalog_manager.cc:1347] Generated new cluster ID: 055703670e6546d08fb280ca9573a009
I20260809 22:54:56.375188 19913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:54:56.393397 19913 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:54:56.394779 19913 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:54:56.400779 19913 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00: Generated new TSK 0
I20260809 22:54:56.401743 19913 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:54:56.409289 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40505
--builtin_ntp_servers=127.23.131.84:35977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 22:54:56.802549 19931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:56.802927 19931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:56.803083 19931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:56.810645 19931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:56.810745 19931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:56.810897 19931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:54:56.820385 19931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:35977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:56.821751 19931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:56.823626 19931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:56.837393 19938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:56.837318 19939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:56.837318 19942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:56.838522 19931 server_base.cc:1034] running on GCE node
I20260809 22:54:56.839259 19931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:56.840231 19931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:56.841477 19931 hybrid_clock.cc:648] HybridClock initialized: now 1786316096841434 us; error 53 us; skew 500 ppm
I20260809 22:54:56.841802 19931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:54:56.844209 19931 webserver.cc:460] Webserver started at http://127.23.131.65:42051/ using document root <none> and password file <none>
I20260809 22:54:56.844937 19931 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:56.845081 19931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:56.845427 19931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:56.848415 19931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "cbcafb08c76c45368e8fead3b05f174d"
format_stamp: "Formatted at 2026-08-09 22:54:56 on dist-test-slave-92m1"
server_key: "390344e2daaf23a8be04ab472e5c88af"
server_key_iv: "0b998941cbf9db90d2fdf7cc877c4215"
server_key_version: "encryptionkey@0"
I20260809 22:54:56.849238 19931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "cbcafb08c76c45368e8fead3b05f174d"
format_stamp: "Formatted at 2026-08-09 22:54:56 on dist-test-slave-92m1"
server_key: "390344e2daaf23a8be04ab472e5c88af"
server_key_iv: "0b998941cbf9db90d2fdf7cc877c4215"
server_key_version: "encryptionkey@0"
I20260809 22:54:56.854413 19931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:54:56.858088 19951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:56.859508 19931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 22:54:56.859709 19931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "cbcafb08c76c45368e8fead3b05f174d"
format_stamp: "Formatted at 2026-08-09 22:54:56 on dist-test-slave-92m1"
server_key: "390344e2daaf23a8be04ab472e5c88af"
server_key_iv: "0b998941cbf9db90d2fdf7cc877c4215"
server_key_version: "encryptionkey@0"
I20260809 22:54:56.859937 19931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:56.894683 19931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:56.895629 19931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:56.895965 19931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:56.897011 19931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:56.898542 19931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:56.898670 19931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:56.898800 19931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:56.898887 19931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:56.933910 19931 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:42447
I20260809 22:54:56.934000 20122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:42447 every 8 connection(s)
I20260809 22:54:56.935312 19931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:54:56.940799 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 19931
I20260809 22:54:56.940994 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:54:56.941457 24077 external_mini_cluster.cc:1428] Setting key 13296ec8f0850982942e816d0476a285
I20260809 22:54:56.944573 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40505
--builtin_ntp_servers=127.23.131.84:35977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 22:54:56.949038 20125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:56.937917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:35475 (local address 127.23.131.126:40505)
0809 22:54:56.938363 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:56.938368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:56.939616 (+ 1248us) server_negotiation.cc:407] Connection header received
0809 22:54:56.941584 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:56.941589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:56.941681 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:56.941803 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:56.942986 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:56.944105 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:56.945803 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:56.946549 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:56.946699 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:56.948060 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:56.948069 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:56.948076 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:56.948101 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:56.948154 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:56.948173 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:56.948269 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:56.948487 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 22:54:56.948598 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":226,"threads_started":1}
I20260809 22:54:56.949816 20126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:56.938524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40505 (local address 127.23.131.65:35475)
0809 22:54:56.939465 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:56.939501 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:56.941312 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:56.942041 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:56.942050 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:56.942131 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:56.942815 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:56.942839 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:56.944304 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:56.944308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:56.945640 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:56.945658 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:56.946771 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:56.946776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:56.946968 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:56.947746 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:54:56.947748 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:56.947787 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:54:56.947860 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:56.948275 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:56.948284 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:56.948289 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 22:54:56.948430 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 22:54:56.948718 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":266,"threads_started":1}
I20260809 22:54:56.951432 20123 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40505
I20260809 22:54:56.951745 20123 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:56.952497 20123 heartbeater.cc:511] Master 127.23.131.126:40505 requested a full tablet report, sending...
I20260809 22:54:56.954514 19841 ts_manager.cc:194] Registered new tserver with Master: cbcafb08c76c45368e8fead3b05f174d (127.23.131.65:42447)
I20260809 22:54:56.956193 19841 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.65:35475
W20260809 22:54:57.305927 20127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:57.306259 20127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:57.306433 20127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:57.313889 20127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:57.314034 20127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:57.314217 20127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:54:57.323649 20127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:35977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:57.324950 20127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:57.326668 20127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:57.340099 20135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:57.340150 20137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:57.340198 20141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:57.341074 20127 server_base.cc:1034] running on GCE node
I20260809 22:54:57.341603 20127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:57.342445 20127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:57.343672 20127 hybrid_clock.cc:648] HybridClock initialized: now 1786316097343602 us; error 39 us; skew 500 ppm
I20260809 22:54:57.343986 20127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:54:57.346283 20127 webserver.cc:460] Webserver started at http://127.23.131.66:41545/ using document root <none> and password file <none>
I20260809 22:54:57.346971 20127 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:57.347100 20127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:57.347465 20127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:57.350297 20127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23"
format_stamp: "Formatted at 2026-08-09 22:54:57 on dist-test-slave-92m1"
server_key: "9b67cee7d394bc1f9792d62f1260d607"
server_key_iv: "271604a5d394ea1a1be11c2a24cf195e"
server_key_version: "encryptionkey@0"
I20260809 22:54:57.351123 20127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23"
format_stamp: "Formatted at 2026-08-09 22:54:57 on dist-test-slave-92m1"
server_key: "9b67cee7d394bc1f9792d62f1260d607"
server_key_iv: "271604a5d394ea1a1be11c2a24cf195e"
server_key_version: "encryptionkey@0"
I20260809 22:54:57.356199 20127 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 22:54:57.359634 20157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:57.361008 20127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 22:54:57.361219 20127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23"
format_stamp: "Formatted at 2026-08-09 22:54:57 on dist-test-slave-92m1"
server_key: "9b67cee7d394bc1f9792d62f1260d607"
server_key_iv: "271604a5d394ea1a1be11c2a24cf195e"
server_key_version: "encryptionkey@0"
I20260809 22:54:57.361459 20127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:57.389935 20127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:57.390866 20127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:57.391215 20127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:57.392277 20127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:57.393827 20127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:57.393954 20127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:57.394105 20127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:57.394198 20127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:57.429056 20127 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:34463
I20260809 22:54:57.429154 20318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:34463 every 8 connection(s)
I20260809 22:54:57.430431 20127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:54:57.433436 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 20127
I20260809 22:54:57.433636 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:54:57.434134 24077 external_mini_cluster.cc:1428] Setting key b14de4cdf9be9635bdb8fc05384afc2d
I20260809 22:54:57.437191 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40505
--builtin_ntp_servers=127.23.131.84:35977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 22:54:57.444252 20125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.433212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:35919 (local address 127.23.131.126:40505)
0809 22:54:57.433462 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:57.433471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:57.434996 (+ 1525us) server_negotiation.cc:407] Connection header received
0809 22:54:57.436870 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:57.436878 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:57.436972 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:57.437091 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:57.438229 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.439456 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.441112 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.441840 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.441981 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:57.443318 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:57.443327 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:57.443334 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:57.443360 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:57.443403 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:57.443422 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:57.443527 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:57.443752 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 22:54:57.443867 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 22:54:57.445209 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.433748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40505 (local address 127.23.131.66:35919)
0809 22:54:57.434819 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:57.434863 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:57.436597 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:57.437311 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:57.437319 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:57.437461 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:57.438045 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:57.438067 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.439654 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.439658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:57.440958 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:57.440971 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.442050 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.442055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:57.442247 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:57.442974 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:54:57.442977 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:57.443027 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:54:57.443102 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:57.443524 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:57.443534 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:57.443539 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 22:54:57.443703 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 22:54:57.443995 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":352,"threads_started":1}
I20260809 22:54:57.446841 20319 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40505
I20260809 22:54:57.447180 20319 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:57.448024 20319 heartbeater.cc:511] Master 127.23.131.126:40505 requested a full tablet report, sending...
I20260809 22:54:57.449602 19841 ts_manager.cc:194] Registered new tserver with Master: 2ab0a3ecd7484cc0aea212e1dfbbfb23 (127.23.131.66:34463)
I20260809 22:54:57.450820 19841 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.66:35919
W20260809 22:54:57.810135 20322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:54:57.810425 20322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:54:57.810590 20322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:54:57.818004 20322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:54:57.818138 20322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:54:57.818312 20322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:54:57.827631 20322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:35977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:40505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:54:57.829041 20322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:54:57.830883 20322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:54:57.845160 20342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:57.845263 20340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:54:57.845209 20338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:54:57.846241 20322 server_base.cc:1034] running on GCE node
I20260809 22:54:57.846956 20322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:54:57.848188 20322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:54:57.849458 20322 hybrid_clock.cc:648] HybridClock initialized: now 1786316097849401 us; error 52 us; skew 500 ppm
I20260809 22:54:57.849817 20322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:54:57.855883 20322 webserver.cc:460] Webserver started at http://127.23.131.67:43631/ using document root <none> and password file <none>
I20260809 22:54:57.856809 20322 fs_manager.cc:359] Metadata directory not provided
I20260809 22:54:57.856954 20322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:54:57.857308 20322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:54:57.860775 20322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "532e230fe9e54b9bb03244adb8b6c513"
format_stamp: "Formatted at 2026-08-09 22:54:57 on dist-test-slave-92m1"
server_key: "6a55b9113799f81383166152077058c8"
server_key_iv: "ff5723ae03efc8bd24dd70ab786fde3f"
server_key_version: "encryptionkey@0"
I20260809 22:54:57.861610 20322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "532e230fe9e54b9bb03244adb8b6c513"
format_stamp: "Formatted at 2026-08-09 22:54:57 on dist-test-slave-92m1"
server_key: "6a55b9113799f81383166152077058c8"
server_key_iv: "ff5723ae03efc8bd24dd70ab786fde3f"
server_key_version: "encryptionkey@0"
I20260809 22:54:57.867431 20322 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 22:54:57.871055 20352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:57.872483 20322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:54:57.872710 20322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "532e230fe9e54b9bb03244adb8b6c513"
format_stamp: "Formatted at 2026-08-09 22:54:57 on dist-test-slave-92m1"
server_key: "6a55b9113799f81383166152077058c8"
server_key_iv: "ff5723ae03efc8bd24dd70ab786fde3f"
server_key_version: "encryptionkey@0"
I20260809 22:54:57.872961 20322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:54:57.892439 20322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:54:57.893436 20322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:54:57.893805 20322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:54:57.894929 20322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:54:57.896569 20322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:54:57.896704 20322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:57.896833 20322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:54:57.896979 20322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:54:57.932017 20322 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:43329
I20260809 22:54:57.932090 20528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:43329 every 8 connection(s)
I20260809 22:54:57.933569 20322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:54:57.938215 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 20322
I20260809 22:54:57.938413 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:54:57.938861 24077 external_mini_cluster.cc:1428] Setting key 407f933b1db3d239a93c4b782d5a72e2
I20260809 22:54:57.947753 20125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.936728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:52615 (local address 127.23.131.126:40505)
0809 22:54:57.936967 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:57.936974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:57.938614 (+ 1640us) server_negotiation.cc:407] Connection header received
0809 22:54:57.941026 (+ 2412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:57.941033 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:57.941127 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:57.941234 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:57.942338 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.943139 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.944916 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.945405 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.945519 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:57.946893 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:57.946898 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:57.946902 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:57.946921 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:57.946956 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:57.946969 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:57.947055 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:57.947386 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 22:54:57.947478 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 22:54:57.948753 20531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.937276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:40505 (local address 127.23.131.67:52615)
0809 22:54:57.938440 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:57.938484 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:57.940700 (+ 2216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:57.941419 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:57.941427 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:57.941510 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:54:57.942184 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:57.942201 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.943324 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.943328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:57.944628 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:57.944641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.945613 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.945618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:57.945812 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:57.946517 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:54:57.946521 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:54:57.946564 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:54:57.946649 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:54:57.947095 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:54:57.947105 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:54:57.947111 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:54:57.947323 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 22:54:57.947639 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":381,"threads_started":1}
I20260809 22:54:57.950304 20529 heartbeater.cc:347] Connected to a master server at 127.23.131.126:40505
I20260809 22:54:57.950661 20529 heartbeater.cc:464] Registering TS with master...
I20260809 22:54:57.951680 20529 heartbeater.cc:511] Master 127.23.131.126:40505 requested a full tablet report, sending...
I20260809 22:54:57.953315 19837 ts_manager.cc:194] Registered new tserver with Master: 532e230fe9e54b9bb03244adb8b6c513 (127.23.131.67:43329)
I20260809 22:54:57.954303 19837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.67:52615
I20260809 22:54:57.954623 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:54:57.959116 20123 heartbeater.cc:503] Master 127.23.131.126:40505 was elected leader, sending a full tablet report...
I20260809 22:54:57.965898 20125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.959356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43282 (local address 127.23.131.126:40505)
0809 22:54:57.959635 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:57.959644 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:57.960080 (+ 436us) server_negotiation.cc:407] Connection header received
0809 22:54:57.960296 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:57.960302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:57.960384 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:57.960505 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:57.961169 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.961961 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.963467 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:57.963944 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:57.964114 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:57.965194 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:57.965199 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:57.965203 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:57.965222 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:57.965268 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:57.965280 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:57.965384 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:57.965477 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 22:54:57.965570 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 22:54:57.969939 19837 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43282:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:54:57.977181 19837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:54:58.018347 20551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.989928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52184 (local address 127.23.131.66:34463)
0809 22:54:58.009048 (+ 19120us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.009060 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.009098 (+ 38us) server_negotiation.cc:407] Connection header received
0809 22:54:58.009221 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.009229 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.009537 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.009759 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:58.010969 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.012633 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.015811 (+ 3178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.017106 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.017277 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.017549 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.017819 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.017993 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18957,"thread_start_us":18824,"threads_started":1}
I20260809 22:54:58.018373 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.989716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:34463 (local address 127.0.0.1:52184)
0809 22:54:58.005919 (+ 16203us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.005995 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:58.006274 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:58.010076 (+ 3802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:58.010088 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:58.010137 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:58.010724 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.010741 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.012813 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.012819 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.015563 (+ 2744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.015578 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.017341 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.017348 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.017546 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.017613 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 22:54:58.017754 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 22:54:58.017942 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15819,"mutex_wait_us":51,"thread_start_us":16804,"threads_started":1}
I20260809 22:54:58.019543 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.990703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49776 (local address 127.23.131.67:43329)
0809 22:54:58.000444 (+ 9741us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.000457 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.010114 (+ 9657us) server_negotiation.cc:407] Connection header received
0809 22:54:58.010534 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.010545 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.010774 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.010965 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:58.012096 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.013613 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.016628 (+ 3015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.018053 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.018197 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.018463 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.018971 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.019150 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9478,"thread_start_us":9289,"threads_started":1}
I20260809 22:54:58.019809 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.991008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58124 (local address 127.23.131.65:42447)
0809 22:54:58.009474 (+ 18466us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.009482 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.010794 (+ 1312us) server_negotiation.cc:407] Connection header received
0809 22:54:58.010902 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.010909 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.011189 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.011405 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:58.012363 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.013560 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.016301 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.017733 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.017904 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.018164 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.019203 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.019410 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18284,"thread_start_us":18125,"threads_started":1}
I20260809 22:54:58.020454 20552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.989924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:43329 (local address 127.0.0.1:49776)
0809 22:54:58.009970 (+ 20046us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.009991 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:58.010253 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:58.011320 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:58.011325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:58.011348 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:58.011802 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.011816 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.013795 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.013800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.016418 (+ 2618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.016433 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.018590 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.018596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.018758 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.018786 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 22:54:58.018862 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 22:54:58.020077 (+ 1215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19907,"mutex_wait_us":1106,"thread_start_us":20239,"threads_started":1}
I20260809 22:54:58.020726 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:57.990275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58124)
0809 22:54:58.010459 (+ 20184us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.010472 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:58.010663 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:58.011677 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:58.011681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:58.011710 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:58.012160 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.012175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.013725 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.013730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.016095 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.016108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.018322 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.018328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.018539 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.018584 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 22:54:58.018671 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 22:54:58.020069 (+ 1398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20051,"mutex_wait_us":82,"thread_start_us":19394,"threads_started":1}
I20260809 22:54:58.022981 20232 tablet_service.cc:1467] Processing CreateTablet for tablet a80e1786c98b4e82a9e790df956514fb (DEFAULT_TABLE table=test-table [id=b0e397f2209f4f3f806149d70e007442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:58.023607 20031 tablet_service.cc:1467] Processing CreateTablet for tablet a80e1786c98b4e82a9e790df956514fb (DEFAULT_TABLE table=test-table [id=b0e397f2209f4f3f806149d70e007442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:58.024605 20232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a80e1786c98b4e82a9e790df956514fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:58.024115 20420 tablet_service.cc:1467] Processing CreateTablet for tablet a80e1786c98b4e82a9e790df956514fb (DEFAULT_TABLE table=test-table [id=b0e397f2209f4f3f806149d70e007442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:54:58.025095 20031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a80e1786c98b4e82a9e790df956514fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:58.025475 20420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a80e1786c98b4e82a9e790df956514fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:54:58.036748 20557 tablet_bootstrap.cc:492] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Bootstrap starting.
I20260809 22:54:58.040347 20558 tablet_bootstrap.cc:492] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Bootstrap starting.
I20260809 22:54:58.042019 20557 tablet_bootstrap.cc:654] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:58.042117 20559 tablet_bootstrap.cc:492] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Bootstrap starting.
I20260809 22:54:58.043583 20557 log.cc:824] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:58.044111 20558 tablet_bootstrap.cc:654] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:58.045281 20558 log.cc:824] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:58.045761 20559 tablet_bootstrap.cc:654] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Neither blocks nor log segments found. Creating new log.
I20260809 22:54:58.047057 20559 log.cc:824] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Log is configured to *not* fsync() on all Append() calls
I20260809 22:54:58.047642 20557 tablet_bootstrap.cc:492] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: No bootstrap required, opened a new log
I20260809 22:54:58.047920 20557 ts_tablet_manager.cc:1397] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260809 22:54:58.049196 20558 tablet_bootstrap.cc:492] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: No bootstrap required, opened a new log
I20260809 22:54:58.049547 20558 ts_tablet_manager.cc:1397] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 22:54:58.055708 20557 raft_consensus.cc:348] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.056115 20559 tablet_bootstrap.cc:492] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: No bootstrap required, opened a new log
I20260809 22:54:58.056209 20557 raft_consensus.cc:374] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:58.056314 20557 raft_consensus.cc:729] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcafb08c76c45368e8fead3b05f174d, State: Initialized, Role: FOLLOWER
I20260809 22:54:58.056468 20559 ts_tablet_manager.cc:1397] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
I20260809 22:54:58.057058 20557 consensus_queue.cc:260] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.061123 20558 raft_consensus.cc:348] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.061615 20558 raft_consensus.cc:374] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:58.061720 20558 raft_consensus.cc:729] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532e230fe9e54b9bb03244adb8b6c513, State: Initialized, Role: FOLLOWER
I20260809 22:54:58.062364 20558 consensus_queue.cc:260] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.063560 20529 heartbeater.cc:503] Master 127.23.131.126:40505 was elected leader, sending a full tablet report...
I20260809 22:54:58.064253 20558 ts_tablet_manager.cc:1428] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260809 22:54:58.064440 20557 ts_tablet_manager.cc:1428] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Time spent starting tablet: real 0.016s user 0.005s sys 0.009s
I20260809 22:54:58.069162 20559 raft_consensus.cc:348] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.069564 20559 raft_consensus.cc:374] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:54:58.069695 20559 raft_consensus.cc:729] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ab0a3ecd7484cc0aea212e1dfbbfb23, State: Initialized, Role: FOLLOWER
I20260809 22:54:58.070281 20559 consensus_queue.cc:260] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.071437 20319 heartbeater.cc:503] Master 127.23.131.126:40505 was elected leader, sending a full tablet report...
I20260809 22:54:58.072206 20559 ts_tablet_manager.cc:1428] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Time spent starting tablet: real 0.016s user 0.011s sys 0.002s
I20260809 22:54:58.176057 20570 raft_consensus.cc:482] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:54:58.176456 20570 raft_consensus.cc:504] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.178562 20570 leader_election.cc:288] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 532e230fe9e54b9bb03244adb8b6c513 (127.23.131.67:43329), cbcafb08c76c45368e8fead3b05f174d (127.23.131.65:42447)
W20260809 22:54:58.182703 20320 tablet.cc:2369] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 22:54:58.185410 20530 tablet.cc:2369] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:54:58.186185 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.179165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:46559 (local address 127.23.131.65:42447)
0809 22:54:58.179439 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.179446 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.180133 (+ 687us) server_negotiation.cc:407] Connection header received
0809 22:54:58.180348 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.180352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.180464 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.180587 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:58.181276 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.182070 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.184323 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.185151 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.185339 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.185430 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.185746 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.185891 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260809 22:54:58.186515 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.178894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:40221 (local address 127.23.131.67:43329)
0809 22:54:58.179130 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.179139 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.179953 (+ 814us) server_negotiation.cc:407] Connection header received
0809 22:54:58.180246 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.180250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.180313 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.180462 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:54:58.181140 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.181917 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.184491 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.185469 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.185669 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.185745 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.186123 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.186275 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260809 22:54:58.186597 20571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.178803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:43329 (local address 127.23.131.66:40221)
0809 22:54:58.179813 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.179837 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:58.180079 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:58.180497 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:58.180502 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:58.180527 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:58.180974 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.180984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.182044 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.182051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.184307 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.184320 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.185777 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.185783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.185946 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.185978 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:54:58.186073 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 22:54:58.186200 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":107,"thread_start_us":549,"threads_started":1}
I20260809 22:54:58.186954 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.179071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.23.131.66:46559)
0809 22:54:58.180014 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.180039 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:54:58.180189 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:54:58.180606 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:54:58.180610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:54:58.180644 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:54:58.181095 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.181104 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.182208 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.182217 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.184125 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:54:58.184138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.185346 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.185352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:54:58.185526 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.185580 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 22:54:58.186440 (+ 860us) client_negotiation.cc:240] Negotiation successful
0809 22:54:58.186593 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":1,"thread_start_us":584,"threads_started":1}
W20260809 22:54:58.187806 20124 tablet.cc:2369] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:54:58.187747 20452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a80e1786c98b4e82a9e790df956514fb" candidate_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532e230fe9e54b9bb03244adb8b6c513" is_pre_election: true
I20260809 22:54:58.188050 20062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a80e1786c98b4e82a9e790df956514fb" candidate_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcafb08c76c45368e8fead3b05f174d" is_pre_election: true
I20260809 22:54:58.188397 20452 raft_consensus.cc:2454] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ab0a3ecd7484cc0aea212e1dfbbfb23 in term 0.
I20260809 22:54:58.188796 20062 raft_consensus.cc:2454] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ab0a3ecd7484cc0aea212e1dfbbfb23 in term 0.
I20260809 22:54:58.189307 20162 leader_election.cc:302] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ab0a3ecd7484cc0aea212e1dfbbfb23, 532e230fe9e54b9bb03244adb8b6c513; no voters:
I20260809 22:54:58.189772 20570 raft_consensus.cc:2781] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:54:58.189951 20570 raft_consensus.cc:482] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:54:58.190075 20570 raft_consensus.cc:3037] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:58.192359 20570 raft_consensus.cc:504] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.192939 20570 leader_election.cc:288] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [CANDIDATE]: Term 1 election: Requested vote from peers 532e230fe9e54b9bb03244adb8b6c513 (127.23.131.67:43329), cbcafb08c76c45368e8fead3b05f174d (127.23.131.65:42447)
I20260809 22:54:58.193390 20452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a80e1786c98b4e82a9e790df956514fb" candidate_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532e230fe9e54b9bb03244adb8b6c513"
I20260809 22:54:58.193501 20062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a80e1786c98b4e82a9e790df956514fb" candidate_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcafb08c76c45368e8fead3b05f174d"
I20260809 22:54:58.193627 20452 raft_consensus.cc:3037] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:58.193718 20062 raft_consensus.cc:3037] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:54:58.197109 20452 raft_consensus.cc:2454] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ab0a3ecd7484cc0aea212e1dfbbfb23 in term 1.
I20260809 22:54:58.197115 20062 raft_consensus.cc:2454] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ab0a3ecd7484cc0aea212e1dfbbfb23 in term 1.
I20260809 22:54:58.197570 20161 leader_election.cc:302] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ab0a3ecd7484cc0aea212e1dfbbfb23, cbcafb08c76c45368e8fead3b05f174d; no voters:
I20260809 22:54:58.197978 20570 raft_consensus.cc:2781] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:54:58.198479 20570 raft_consensus.cc:686] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 1 LEADER]: Becoming Leader. State: Replica: 2ab0a3ecd7484cc0aea212e1dfbbfb23, State: Running, Role: LEADER
I20260809 22:54:58.199100 20570 consensus_queue.cc:237] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } }
I20260809 22:54:58.204036 19837 catalog_manager.cc:5495] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ab0a3ecd7484cc0aea212e1dfbbfb23 (127.23.131.66). New cstate: current_term: 1 leader_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ab0a3ecd7484cc0aea212e1dfbbfb23" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 } health_report { overall_health: UNKNOWN } } }
I20260809 22:54:58.258831 20551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.252964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52190 (local address 127.23.131.66:34463)
0809 22:54:58.253202 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.253206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.253222 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:54:58.253312 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.253316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.253468 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.253645 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:54:58.254063 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.254783 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.256616 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.257125 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.257232 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.257747 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:54:58.258327 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:54:58.258445 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.258548 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.258621 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:54:58.268204 20452 raft_consensus.cc:1261] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 1 FOLLOWER]: Refusing update from remote peer 2ab0a3ecd7484cc0aea212e1dfbbfb23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:54:58.268205 20062 raft_consensus.cc:1261] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 1 FOLLOWER]: Refusing update from remote peer 2ab0a3ecd7484cc0aea212e1dfbbfb23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:54:58.269556 20573 consensus_queue.cc:1035] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532e230fe9e54b9bb03244adb8b6c513" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:54:58.270000 20570 consensus_queue.cc:1035] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcafb08c76c45368e8fead3b05f174d" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:54:58.283802 20581 mvcc.cc:205] Tried to move back new op lower bound from 7316750738494693376 to 7316750738228781056. Current Snapshot: MvccSnapshot[applied={T|T < 7316750738494693376}]
I20260809 22:54:58.297351 19837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:54:58.297696 19837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:54:58.301529 19837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5447fa525a494d70b4ab7bd43fc64d00: Sending DeleteTablet for 3 replicas of tablet a80e1786c98b4e82a9e790df956514fb
I20260809 22:54:58.302754 20232 tablet_service.cc:1514] Processing DeleteTablet for tablet a80e1786c98b4e82a9e790df956514fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:58 UTC) from {username='slave'} at 127.0.0.1:52184
I20260809 22:54:58.302827 20420 tablet_service.cc:1514] Processing DeleteTablet for tablet a80e1786c98b4e82a9e790df956514fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:58 UTC) from {username='slave'} at 127.0.0.1:49776
I20260809 22:54:58.303112 20031 tablet_service.cc:1514] Processing DeleteTablet for tablet a80e1786c98b4e82a9e790df956514fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:54:58 UTC) from {username='slave'} at 127.0.0.1:58124
I20260809 22:54:58.305282 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 19931
I20260809 22:54:58.320780 20595 tablet_replica.cc:330] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: stopping tablet replica
I20260809 22:54:58.321550 20595 raft_consensus.cc:2229] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:54:58.322373 20595 raft_consensus.cc:2258] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:58.323280 20596 tablet_replica.cc:330] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: stopping tablet replica
I20260809 22:54:58.325605 20595 ts_tablet_manager.cc:1905] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:58.326843 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.309025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58128 (local address 127.23.131.65:42447)
0809 22:54:58.309283 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.309291 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.312037 (+ 2746us) server_negotiation.cc:407] Connection header received
0809 22:54:58.312826 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.312836 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.312985 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.313099 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:58.314521 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.316084 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.321490 (+ 5406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.322114 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.322228 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.324877 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:58.324888 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:58.324904 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:58.325692 (+ 788us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:58.325756 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:58.325779 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:58.325861 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.326326 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.326462 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:54:58.336172 20596 raft_consensus.cc:2229] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:54:58.336447 20594 tablet_replica.cc:330] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: stopping tablet replica
I20260809 22:54:58.336493 20117 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:58.336966 20594 raft_consensus.cc:2229] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:54:58.337548 20594 raft_consensus.cc:2258] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:58.337649 20595 ts_tablet_manager.cc:1918] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:58.337867 20595 log.cc:1196] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/a80e1786c98b4e82a9e790df956514fb
I20260809 22:54:58.338507 20595 ts_tablet_manager.cc:1939] T a80e1786c98b4e82a9e790df956514fb P 2ab0a3ecd7484cc0aea212e1dfbbfb23: Deleting consensus metadata
I20260809 22:54:58.340322 20594 ts_tablet_manager.cc:1905] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:58.340459 19813 catalog_manager.cc:4841] TS 2ab0a3ecd7484cc0aea212e1dfbbfb23 (127.23.131.66:34463): tablet a80e1786c98b4e82a9e790df956514fb (table test-table [id=b0e397f2209f4f3f806149d70e007442]) successfully deleted
I20260809 22:54:58.348354 20594 ts_tablet_manager.cc:1918] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:54:58.348536 20594 log.cc:1196] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/a80e1786c98b4e82a9e790df956514fb
I20260809 22:54:58.349095 20594 ts_tablet_manager.cc:1939] T a80e1786c98b4e82a9e790df956514fb P 532e230fe9e54b9bb03244adb8b6c513: Deleting consensus metadata
I20260809 22:54:58.351087 19817 catalog_manager.cc:4841] TS 532e230fe9e54b9bb03244adb8b6c513 (127.23.131.67:43329): tablet a80e1786c98b4e82a9e790df956514fb (table test-table [id=b0e397f2209f4f3f806149d70e007442]) successfully deleted
I20260809 22:54:58.438968 20596 raft_consensus.cc:2258] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:54:58.441614 20596 ts_tablet_manager.cc:1905] T a80e1786c98b4e82a9e790df956514fb P cbcafb08c76c45368e8fead3b05f174d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:54:58.444011 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 19931
I20260809 22:54:58.480719 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 20127
W20260809 22:54:58.480628 19815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:42447 (error 108)
I20260809 22:54:58.482656 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.482127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58130)
0809 22:54:58.482299 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.482473 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 22:54:58.483178 19815 catalog_manager.cc:4584] TS cbcafb08c76c45368e8fead3b05f174d (127.23.131.65:42447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a80e1786c98b4e82a9e790df956514fb: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
I20260809 22:54:58.490175 20551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.482306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.23.131.66:34463)
0809 22:54:58.482550 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.482556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.482575 (+ 19us) server_negotiation.cc:407] Connection header received
0809 22:54:58.482649 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.482656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.482776 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.482915 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:58.483422 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.484671 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.486163 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.486865 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.487017 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.488396 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:58.488409 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:58.488429 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:58.489289 (+ 860us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:58.489352 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:58.489379 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:58.489517 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.489663 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.489773 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 22:54:58.491000 20314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:58.536870 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.536293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58134)
0809 22:54:58.536552 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.536683 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 22:54:58.538033 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.537624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58140)
0809 22:54:58.537784 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.537886 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 22:54:58.598865 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.598220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58154)
0809 22:54:58.598509 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.598651 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 22:54:58.600057 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.599662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58166)
0809 22:54:58.599827 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.599911 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 22:54:58.610034 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 20127
I20260809 22:54:58.637442 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 20322
I20260809 22:54:58.644071 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.638251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49790 (local address 127.23.131.67:43329)
0809 22:54:58.638440 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 22:54:58.638444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:54:58.638516 (+ 72us) server_negotiation.cc:407] Connection header received
0809 22:54:58.638667 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:54:58.638672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:54:58.638755 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:54:58.638838 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:54:58.639279 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.640053 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.641326 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:54:58.641705 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:54:58.641797 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:54:58.642760 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:54:58.642769 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:54:58.642783 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:54:58.643430 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:54:58.643484 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:54:58.643504 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:54:58.643594 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 22:54:58.643726 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 22:54:58.643811 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:54:58.644702 20522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:58.680622 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.680076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58178)
0809 22:54:58.680313 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.680426 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 22:54:58.681686 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.681293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58192)
0809 22:54:58.681491 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.681573 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 22:54:58.735890 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 20322
I20260809 22:54:58.761675 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 19794
I20260809 22:54:58.762926 19890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:54:58.877645 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.877078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58202)
0809 22:54:58.877354 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.877464 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260809 22:54:58.878755 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:54:58.878385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42447 (local address 127.0.0.1:58212)
0809 22:54:58.878573 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 22:54:58.878646 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 22:54:58.878832 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 19794
2026-08-09T22:54:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3138 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:54:59 dist-test-slave-92m1 krb5kdc[20612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:54:59 dist-test-slave-92m1 krb5kdc[20612](info): set up 2 sockets
Aug 09 22:54:59 dist-test-slave-92m1 krb5kdc[20612](info): commencing operation
krb5kdc: starting...
W20260809 22:55:00.280805 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.002s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:00 dist-test-slave-92m1 krb5kdc[20612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:00.660553 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41773
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:41773
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:01.018390 20639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:01.018807 20639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:01.018975 20639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:01.027129 20639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:01.027310 20639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:01.027398 20639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:01.027486 20639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:01.027556 20639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:01.037791 20639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:41773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:41773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:01.039261 20639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:01.040678 20639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:01.053170 20648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:01.053236 20649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:01.053198 20652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:01.054395 20639 server_base.cc:1034] running on GCE node
I20260809 22:55:01.055187 20639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:01.056783 20639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:01.058027 20639 hybrid_clock.cc:648] HybridClock initialized: now 1786316101057944 us; error 71 us; skew 500 ppm
I20260809 22:55:01.058398 20639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:01 dist-test-slave-92m1 krb5kdc[20612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316101, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:01.061811 20639 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:01.063458 20639 webserver.cc:460] Webserver started at http://127.23.131.126:40003/ using document root <none> and password file <none>
I20260809 22:55:01.064222 20639 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:01.064384 20639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:01.064731 20639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:01.068189 20639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "9d2d83ac058b40589f0f17e061179e85"
format_stamp: "Formatted at 2026-08-09 22:55:01 on dist-test-slave-92m1"
server_key: "11e2d8fef9bac100dcf93c1868b5b8b0"
server_key_iv: "0515807b3589e357a1da3e8a97f2ac2e"
server_key_version: "encryptionkey@0"
I20260809 22:55:01.069031 20639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "9d2d83ac058b40589f0f17e061179e85"
format_stamp: "Formatted at 2026-08-09 22:55:01 on dist-test-slave-92m1"
server_key: "11e2d8fef9bac100dcf93c1868b5b8b0"
server_key_iv: "0515807b3589e357a1da3e8a97f2ac2e"
server_key_version: "encryptionkey@0"
I20260809 22:55:01.074837 20639 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:55:01.078684 20662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:01.080137 20639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:01.080348 20639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "9d2d83ac058b40589f0f17e061179e85"
format_stamp: "Formatted at 2026-08-09 22:55:01 on dist-test-slave-92m1"
server_key: "11e2d8fef9bac100dcf93c1868b5b8b0"
server_key_iv: "0515807b3589e357a1da3e8a97f2ac2e"
server_key_version: "encryptionkey@0"
I20260809 22:55:01.080587 20639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:01.103024 20639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:01.108001 20639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:01.108335 20639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:01.128052 20639 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:41773
I20260809 22:55:01.128077 20743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:41773 every 8 connection(s)
I20260809 22:55:01.129561 20639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:01.133566 20747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:01.137837 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 20639
I20260809 22:55:01.138051 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:01.138532 24077 external_mini_cluster.cc:1428] Setting key 3bc8f2d4d390eb2af6d31632429f929a
I20260809 22:55:01.147354 20747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85: Bootstrap starting.
I20260809 22:55:01.151391 20747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:01.152858 20747 log.cc:824] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:55:01 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:01.156440 20747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85: No bootstrap required, opened a new log
I20260809 22:55:01.163133 20753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:01.140449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52470 (local address 127.23.131.126:41773)
0809 22:55:01.141281 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:01.141293 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:01.141335 (+ 42us) server_negotiation.cc:407] Connection header received
0809 22:55:01.142971 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:01.142994 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:01.143489 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:01.143812 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:01.145769 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:01.147061 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:01.148962 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:01.149694 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:01.149835 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:01.155443 (+ 5608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:01.155453 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:01.155467 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:01.155508 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:01.158733 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:01.159730 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:01.159737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:01.159747 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:01.159917 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:01.160345 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:01.160348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:01.160350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:01.160896 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:01.161136 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:01.161616 (+ 480us) server_negotiation.cc:299] Negotiation successful
0809 22:55:01.162000 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":392,"threads_started":1}
I20260809 22:55:01.165759 20747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2d83ac058b40589f0f17e061179e85" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41773 } }
I20260809 22:55:01.166180 20747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:01.166289 20747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2d83ac058b40589f0f17e061179e85, State: Initialized, Role: FOLLOWER
I20260809 22:55:01.166833 20747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2d83ac058b40589f0f17e061179e85" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41773 } }
I20260809 22:55:01.167088 20747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:01.167263 20747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:01.167449 20747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:01.169746 20747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2d83ac058b40589f0f17e061179e85" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41773 } }
I20260809 22:55:01.170285 20747 leader_election.cc:302] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d2d83ac058b40589f0f17e061179e85; no voters:
I20260809 22:55:01.170933 20747 leader_election.cc:288] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:01.171113 20757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:01.171905 20757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [term 1 LEADER]: Becoming Leader. State: Replica: 9d2d83ac058b40589f0f17e061179e85, State: Running, Role: LEADER
I20260809 22:55:01.172475 20757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2d83ac058b40589f0f17e061179e85" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41773 } }
I20260809 22:55:01.173197 20747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:01.175689 20760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d2d83ac058b40589f0f17e061179e85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2d83ac058b40589f0f17e061179e85" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41773 } } }
I20260809 22:55:01.176153 20760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:01.181165 20761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d2d83ac058b40589f0f17e061179e85. Latest consensus state: current_term: 1 leader_uuid: "9d2d83ac058b40589f0f17e061179e85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d2d83ac058b40589f0f17e061179e85" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 41773 } } }
I20260809 22:55:01.181591 20761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:01.183326 20768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:01.189179 20768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:01.198835 20768 catalog_manager.cc:1347] Generated new cluster ID: 6d580e950c7a4e758c84b5655f888458
I20260809 22:55:01.198962 20768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:01.217468 20768 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:01.219146 20768 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:01.226701 20768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85: Generated new TSK 0
I20260809 22:55:01.227653 20768 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:55:01.320886 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41773
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:01.685704 20799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:01.686002 20799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:01.686177 20799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:01.693889 20799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:01.694022 20799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:01.694258 20799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:55:01.704433 20799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41773
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:01.705909 20799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:01.707402 20799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:01.721109 20807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:01.721069 20812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:01.721136 20808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:01.722362 20799 server_base.cc:1034] running on GCE node
I20260809 22:55:01.722963 20799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:01.723968 20799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:01.725229 20799 hybrid_clock.cc:648] HybridClock initialized: now 1786316101725176 us; error 44 us; skew 500 ppm
I20260809 22:55:01.725654 20799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:01 dist-test-slave-92m1 krb5kdc[20612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316101, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:01.729147 20799 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:55:01.730821 20799 webserver.cc:460] Webserver started at http://127.23.131.65:37801/ using document root <none> and password file <none>
I20260809 22:55:01.731613 20799 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:01.731727 20799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:01.732010 20799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:01.735069 20799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "cd53860159814e31b7ccd6a060c36c85"
format_stamp: "Formatted at 2026-08-09 22:55:01 on dist-test-slave-92m1"
server_key: "928ee569ecd6c50a815a54e8b863ef0b"
server_key_iv: "38f12e4db991926f3b5736ac178d6362"
server_key_version: "encryptionkey@0"
I20260809 22:55:01.735924 20799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "cd53860159814e31b7ccd6a060c36c85"
format_stamp: "Formatted at 2026-08-09 22:55:01 on dist-test-slave-92m1"
server_key: "928ee569ecd6c50a815a54e8b863ef0b"
server_key_iv: "38f12e4db991926f3b5736ac178d6362"
server_key_version: "encryptionkey@0"
I20260809 22:55:01.741406 20799 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:01.745031 20823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:01.746354 20799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:55:01.746495 20799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "cd53860159814e31b7ccd6a060c36c85"
format_stamp: "Formatted at 2026-08-09 22:55:01 on dist-test-slave-92m1"
server_key: "928ee569ecd6c50a815a54e8b863ef0b"
server_key_iv: "38f12e4db991926f3b5736ac178d6362"
server_key_version: "encryptionkey@0"
I20260809 22:55:01.746677 20799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:01.770794 20799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:01.775648 20799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:01.775916 20799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:01.776973 20799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:01.778548 20799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:01.778625 20799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:01.778753 20799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:01.778827 20799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:01.813453 20799 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:40329
I20260809 22:55:01.813498 20989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:40329 every 8 connection(s)
I20260809 22:55:01.814925 20799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:55:01.819734 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 20799
I20260809 22:55:01.819913 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:55:01.820394 24077 external_mini_cluster.cc:1428] Setting key b8a4cf43c6fcef20ab707ec29249c521
Aug 09 22:55:01 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316101, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:01.835417 20995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:01.817505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:41581 (local address 127.23.131.126:41773)
0809 22:55:01.817998 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:01.818005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:01.818977 (+ 972us) server_negotiation.cc:407] Connection header received
0809 22:55:01.821004 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:01.821009 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:01.821110 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:01.821236 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:01.823051 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:01.823864 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:01.825432 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:01.825865 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:01.826006 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:01.829573 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:01.829578 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:01.829581 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:01.829614 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:01.832197 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:01.832982 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:01.832992 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:01.832995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:01.833128 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:01.833569 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:01.833577 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:01.833582 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:01.833862 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:01.834026 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:01.834762 (+ 736us) server_negotiation.cc:299] Negotiation successful
0809 22:55:01.834999 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":229,"threads_started":1}
I20260809 22:55:01.836403 20999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:01.818078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41773 (local address 127.23.131.65:41581)
0809 22:55:01.818809 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:01.818860 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:01.820723 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:01.821506 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:01.821517 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:01.822306 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:01.822862 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:01.822878 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:01.824045 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:01.824050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:01.825274 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:01.825286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:01.826116 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:01.826125 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:01.826363 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:01.827078 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:55:01.827101 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:01.829339 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:01.832352 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:01.832361 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:01.832378 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:01.832844 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:01.833247 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:01.833252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:01.833256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:01.833454 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:01.834013 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:01.834021 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:01.834367 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 22:55:01.834659 (+ 292us) client_negotiation.cc:240] Negotiation successful
0809 22:55:01.835236 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":280,"threads_started":1}
I20260809 22:55:01.838161 20990 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41773
I20260809 22:55:01.838507 20990 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:01.839349 20990 heartbeater.cc:511] Master 127.23.131.126:41773 requested a full tablet report, sending...
I20260809 22:55:01.841539 20689 ts_manager.cc:194] Registered new tserver with Master: cd53860159814e31b7ccd6a060c36c85 (127.23.131.65:40329)
I20260809 22:55:01.843055 20689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:41581
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:55:01.902364 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41773
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:02.257551 21003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:02.257876 21003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:02.258049 21003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:02.265416 21003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:02.265578 21003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:02.265764 21003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:55:02.275792 21003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41773
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:02.277176 21003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:02.278563 21003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:02.292794 21010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:02.292757 21018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:02.292711 21020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:02.294267 21003 server_base.cc:1034] running on GCE node
I20260809 22:55:02.294951 21003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:02.295992 21003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:02.297241 21003 hybrid_clock.cc:648] HybridClock initialized: now 1786316102297192 us; error 59 us; skew 500 ppm
I20260809 22:55:02.297572 21003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:02 dist-test-slave-92m1 krb5kdc[20612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316102, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:02.300922 21003 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:55:02.302426 21003 webserver.cc:460] Webserver started at http://127.23.131.66:43065/ using document root <none> and password file <none>
I20260809 22:55:02.303107 21003 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:02.303263 21003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:02.303570 21003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:02.306532 21003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "9578029b28d54552ae8b2a5310c49da6"
format_stamp: "Formatted at 2026-08-09 22:55:02 on dist-test-slave-92m1"
server_key: "648662126a08794d3a3ca2289d01c19a"
server_key_iv: "3ebf3aa48f4014f7855324bd09b27628"
server_key_version: "encryptionkey@0"
I20260809 22:55:02.307379 21003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "9578029b28d54552ae8b2a5310c49da6"
format_stamp: "Formatted at 2026-08-09 22:55:02 on dist-test-slave-92m1"
server_key: "648662126a08794d3a3ca2289d01c19a"
server_key_iv: "3ebf3aa48f4014f7855324bd09b27628"
server_key_version: "encryptionkey@0"
I20260809 22:55:02.312753 21003 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 22:55:02.316468 21033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:02.317804 21003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:55:02.317947 21003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "9578029b28d54552ae8b2a5310c49da6"
format_stamp: "Formatted at 2026-08-09 22:55:02 on dist-test-slave-92m1"
server_key: "648662126a08794d3a3ca2289d01c19a"
server_key_iv: "3ebf3aa48f4014f7855324bd09b27628"
server_key_version: "encryptionkey@0"
I20260809 22:55:02.318128 21003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:02.336585 21003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:02.340649 21003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:02.340890 21003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:02.341785 21003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:02.343108 21003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:02.343190 21003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:02.343365 21003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:02.343415 21003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:02.379066 21003 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:45517
I20260809 22:55:02.379101 21207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:45517 every 8 connection(s)
I20260809 22:55:02.380432 21003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:55:02.389765 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 21003
I20260809 22:55:02.389959 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:55:02.390434 24077 external_mini_cluster.cc:1428] Setting key 4eac48384022536710168802b72bebb0
Aug 09 22:55:02 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316102, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:02.400952 21215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:02.382945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:54889 (local address 127.23.131.126:41773)
0809 22:55:02.383434 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:02.383440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:02.384523 (+ 1083us) server_negotiation.cc:407] Connection header received
0809 22:55:02.386624 (+ 2101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:02.386629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:02.386697 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:02.386787 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:02.388358 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.389072 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.390759 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.391266 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.391395 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:02.395079 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:02.395084 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:02.395087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:02.395119 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:02.397765 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:02.398500 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:02.398508 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:02.398522 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:02.398661 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:02.399099 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:02.399105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:02.399109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:02.399468 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:02.399632 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:02.400322 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 22:55:02.400567 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":213,"threads_started":1}
I20260809 22:55:02.401919 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:02.383588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41773 (local address 127.23.131.66:54889)
0809 22:55:02.384348 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:02.384412 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:02.386299 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:02.386993 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:02.387001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:02.387634 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:02.388201 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:02.388217 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.389209 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.389213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:02.390614 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:02.390626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.391512 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.391536 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:02.391817 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:02.392605 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:55:02.392650 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:02.394836 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:02.397913 (+ 3077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:02.397922 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:02.397938 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:02.398380 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:02.398778 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:02.398783 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:02.398787 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:02.398978 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:02.399604 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:02.399612 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:02.399955 (+ 343us) client_negotiation.cc:769] Sending connection context
0809 22:55:02.400236 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 22:55:02.400771 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":271,"threads_started":1}
I20260809 22:55:02.403429 21209 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41773
I20260809 22:55:02.403744 21209 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:02.404461 21209 heartbeater.cc:511] Master 127.23.131.126:41773 requested a full tablet report, sending...
I20260809 22:55:02.406036 20689 ts_manager.cc:194] Registered new tserver with Master: 9578029b28d54552ae8b2a5310c49da6 (127.23.131.66:45517)
I20260809 22:55:02.407316 20689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:54889
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:55:02.468695 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41773
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:02.826653 21224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:02.826988 21224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:02.827165 21224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:02.834585 21224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:02.834744 21224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:02.834928 21224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:55:02.845115 21224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:41773
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:02.846109 20990 heartbeater.cc:503] Master 127.23.131.126:41773 was elected leader, sending a full tablet report...
I20260809 22:55:02.846628 21224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:02.848023 21224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:02.862110 21234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:02.862187 21231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:02.862146 21230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:02.862972 21224 server_base.cc:1034] running on GCE node
I20260809 22:55:02.863663 21224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:02.864640 21224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:02.865867 21224 hybrid_clock.cc:648] HybridClock initialized: now 1786316102865804 us; error 57 us; skew 500 ppm
I20260809 22:55:02.866231 21224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:02 dist-test-slave-92m1 krb5kdc[20612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316102, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:02.873907 21224 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:55:02.875540 21224 webserver.cc:460] Webserver started at http://127.23.131.67:45697/ using document root <none> and password file <none>
I20260809 22:55:02.876286 21224 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:02.876401 21224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:02.876699 21224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:02.879704 21224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "912dc275bffb4f53ac0393b2ae771ed4"
format_stamp: "Formatted at 2026-08-09 22:55:02 on dist-test-slave-92m1"
server_key: "c7a762c993c623960f929ebe98666202"
server_key_iv: "30fa50a2db7c805d75fbbdf87b01f8f0"
server_key_version: "encryptionkey@0"
I20260809 22:55:02.880425 21224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "912dc275bffb4f53ac0393b2ae771ed4"
format_stamp: "Formatted at 2026-08-09 22:55:02 on dist-test-slave-92m1"
server_key: "c7a762c993c623960f929ebe98666202"
server_key_iv: "30fa50a2db7c805d75fbbdf87b01f8f0"
server_key_version: "encryptionkey@0"
I20260809 22:55:02.885856 21224 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:02.889555 21243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:02.890964 21224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:02.891119 21224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "912dc275bffb4f53ac0393b2ae771ed4"
format_stamp: "Formatted at 2026-08-09 22:55:02 on dist-test-slave-92m1"
server_key: "c7a762c993c623960f929ebe98666202"
server_key_iv: "30fa50a2db7c805d75fbbdf87b01f8f0"
server_key_version: "encryptionkey@0"
I20260809 22:55:02.891373 21224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:02.913594 21224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:02.917824 21224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:02.918088 21224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:02.919003 21224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:02.920383 21224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:02.920462 21224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:02.920552 21224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:02.920598 21224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:02.956334 21224 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:34963
I20260809 22:55:02.956429 21419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:34963 every 8 connection(s)
I20260809 22:55:02.957787 21224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:55:02.968187 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 21224
I20260809 22:55:02.968410 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:55:02.968920 24077 external_mini_cluster.cc:1428] Setting key ed8d48e3b9ec09bc25b8b494b24c4828
Aug 09 22:55:02 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316102, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:02.978029 21423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:02.960667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:39171 (local address 127.23.131.126:41773)
0809 22:55:02.961153 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:02.961157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:02.961994 (+ 837us) server_negotiation.cc:407] Connection header received
0809 22:55:02.963996 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:02.964003 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:02.964111 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:02.964234 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:02.965795 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.966616 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.968251 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.968767 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.968908 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:02.972511 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:02.972516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:02.972519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:02.972553 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:02.975195 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:02.975949 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:02.975953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:02.975956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:02.976103 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:02.976488 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:02.976491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:02.976493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:02.976756 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:02.976880 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:02.977560 (+ 680us) server_negotiation.cc:299] Negotiation successful
0809 22:55:02.977739 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":258,"threads_started":1}
I20260809 22:55:02.979028 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:02.961079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:41773 (local address 127.23.131.67:39171)
0809 22:55:02.961830 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:02.961869 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:02.963708 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:02.964480 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:02.964489 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:02.965057 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:02.965620 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:02.965638 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.966785 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.966789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:02.968088 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:02.968101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.969007 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.969014 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:02.969257 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:02.969979 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:55:02.970009 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:02.972316 (+ 2307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:02.975375 (+ 3059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:02.975382 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:02.975396 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:02.975829 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:02.976199 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:02.976202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:02.976204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:02.976389 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:02.976872 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:02.976878 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:02.977202 (+ 324us) client_negotiation.cc:769] Sending connection context
0809 22:55:02.977429 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 22:55:02.977829 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":295,"threads_started":1}
I20260809 22:55:02.980643 21420 heartbeater.cc:347] Connected to a master server at 127.23.131.126:41773
I20260809 22:55:02.980940 21420 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:02.981652 21420 heartbeater.cc:511] Master 127.23.131.126:41773 requested a full tablet report, sending...
I20260809 22:55:02.983516 20688 ts_manager.cc:194] Registered new tserver with Master: 912dc275bffb4f53ac0393b2ae771ed4 (127.23.131.67:34963)
I20260809 22:55:02.984582 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:55:02.984747 20688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:39171
I20260809 22:55:03.003739 21423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:02.989868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52480 (local address 127.23.131.126:41773)
0809 22:55:02.990101 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:02.990106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:02.990680 (+ 574us) server_negotiation.cc:407] Connection header received
0809 22:55:02.990743 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:02.990746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:02.990811 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:02.990913 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:02.992386 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.993166 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.994538 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:02.995013 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:02.995144 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:02.998093 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:02.998098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:02.998101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:02.998138 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:03.000966 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.001797 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.001801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.001803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.001927 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.002356 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.002359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.002361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.002687 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:03.002906 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.003323 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.003474 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 22:55:03.008358 20688 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:55:03.015707 20688 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:55:03.055612 21445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.031700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:40329 (local address 127.0.0.1:42056)
0809 22:55:03.045730 (+ 14030us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:03.045751 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:03.045902 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:03.047058 (+ 1156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:03.047068 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:03.047104 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:03.047627 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.047644 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.049322 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.049327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.052309 (+ 2982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.052326 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.054236 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.054244 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.054468 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.054654 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 22:55:03.054785 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 22:55:03.055037 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13844,"mutex_wait_us":79,"thread_start_us":13687,"threads_started":1}
I20260809 22:55:03.056636 21447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.032155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42056 (local address 127.23.131.65:40329)
0809 22:55:03.044830 (+ 12675us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.044845 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.046054 (+ 1209us) server_negotiation.cc:407] Connection header received
0809 22:55:03.046183 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.046195 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.046485 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.046739 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:03.047831 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.049140 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.052505 (+ 3365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.053998 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.054149 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.054380 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.056088 (+ 1708us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.056280 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12334,"thread_start_us":12688,"threads_started":1}
I20260809 22:55:03.058683 21440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.030030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:34963 (local address 127.0.0.1:35074)
0809 22:55:03.045138 (+ 15108us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:03.045162 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:03.045358 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:03.050646 (+ 5288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:03.050650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:03.050677 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:03.052381 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.052395 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.054009 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.054017 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.056311 (+ 2294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.056324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.057801 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.057808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.057989 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.058031 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 22:55:03.058115 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 22:55:03.058258 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14936,"mutex_wait_us":640,"thread_start_us":333,"threads_started":1}
I20260809 22:55:03.058724 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.030136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35074 (local address 127.23.131.67:34963)
0809 22:55:03.049911 (+ 19775us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.049925 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.049970 (+ 45us) server_negotiation.cc:407] Connection header received
0809 22:55:03.050092 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.050103 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.050408 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.050657 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:03.052703 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.053867 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.056488 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.057565 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.057739 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.057997 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.058210 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.058386 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19491,"thread_start_us":20816,"threads_started":1}
I20260809 22:55:03.061013 20891 tablet_service.cc:1467] Processing CreateTablet for tablet 12d2ee70c402409da068b88e850c5d8e (DEFAULT_TABLE table=test-table [id=27ea4e0bb8fe464eb75bf26ce64669de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:03.062714 20891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d2ee70c402409da068b88e850c5d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:03.062893 21315 tablet_service.cc:1467] Processing CreateTablet for tablet 12d2ee70c402409da068b88e850c5d8e (DEFAULT_TABLE table=test-table [id=27ea4e0bb8fe464eb75bf26ce64669de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:03.064463 21315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d2ee70c402409da068b88e850c5d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:03.065841 21441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.029750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52682 (local address 127.23.131.66:45517)
0809 22:55:03.051644 (+ 21894us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.051654 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.051685 (+ 31us) server_negotiation.cc:407] Connection header received
0809 22:55:03.051792 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.051799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.052006 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.052192 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:03.052991 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.054507 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.058017 (+ 3510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.059645 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.064749 (+ 5104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.064969 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.065316 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.065501 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21723,"thread_start_us":21594,"threads_started":1}
I20260809 22:55:03.065868 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.029520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:45517 (local address 127.0.0.1:52682)
0809 22:55:03.030754 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:03.030794 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:03.030974 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:03.052195 (+ 21221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:03.052201 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:03.052234 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:03.052795 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.052812 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.054705 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.054710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.057770 (+ 3060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.057792 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.059911 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.059918 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.065064 (+ 5146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.065102 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 22:55:03.065237 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 22:55:03.065403 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"mutex_wait_us":364,"thread_start_us":15254,"threads_started":1}
I20260809 22:55:03.070147 21103 tablet_service.cc:1467] Processing CreateTablet for tablet 12d2ee70c402409da068b88e850c5d8e (DEFAULT_TABLE table=test-table [id=27ea4e0bb8fe464eb75bf26ce64669de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:03.071763 21103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d2ee70c402409da068b88e850c5d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:03.079049 21448 tablet_bootstrap.cc:492] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Bootstrap starting.
I20260809 22:55:03.081358 21455 tablet_bootstrap.cc:492] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Bootstrap starting.
I20260809 22:55:03.083331 21448 tablet_bootstrap.cc:654] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:03.084892 21448 log.cc:824] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:03.085330 21455 tablet_bootstrap.cc:654] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:03.086783 21455 log.cc:824] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:03.089172 21459 tablet_bootstrap.cc:492] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Bootstrap starting.
I20260809 22:55:03.089994 21448 tablet_bootstrap.cc:492] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: No bootstrap required, opened a new log
I20260809 22:55:03.090349 21448 ts_tablet_manager.cc:1397] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 22:55:03.090983 21455 tablet_bootstrap.cc:492] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: No bootstrap required, opened a new log
I20260809 22:55:03.091316 21455 ts_tablet_manager.cc:1397] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260809 22:55:03.093248 21459 tablet_bootstrap.cc:654] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:03.094573 21459 log.cc:824] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:03.098009 21459 tablet_bootstrap.cc:492] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: No bootstrap required, opened a new log
I20260809 22:55:03.098317 21459 ts_tablet_manager.cc:1397] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260809 22:55:03.099308 21448 raft_consensus.cc:348] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.099699 21448 raft_consensus.cc:374] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:03.099831 21448 raft_consensus.cc:729] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd53860159814e31b7ccd6a060c36c85, State: Initialized, Role: FOLLOWER
I20260809 22:55:03.100504 21448 consensus_queue.cc:260] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.102371 21448 ts_tablet_manager.cc:1428] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260809 22:55:03.102392 21455 raft_consensus.cc:348] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.102870 21455 raft_consensus.cc:374] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:03.102988 21455 raft_consensus.cc:729] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 912dc275bffb4f53ac0393b2ae771ed4, State: Initialized, Role: FOLLOWER
I20260809 22:55:03.103766 21455 consensus_queue.cc:260] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.106806 21420 heartbeater.cc:503] Master 127.23.131.126:41773 was elected leader, sending a full tablet report...
I20260809 22:55:03.107085 21455 ts_tablet_manager.cc:1428] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Time spent starting tablet: real 0.016s user 0.006s sys 0.008s
I20260809 22:55:03.109357 21459 raft_consensus.cc:348] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.109772 21459 raft_consensus.cc:374] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:03.109899 21459 raft_consensus.cc:729] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9578029b28d54552ae8b2a5310c49da6, State: Initialized, Role: FOLLOWER
I20260809 22:55:03.110533 21459 consensus_queue.cc:260] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.111764 21209 heartbeater.cc:503] Master 127.23.131.126:41773 was elected leader, sending a full tablet report...
I20260809 22:55:03.112394 21459 ts_tablet_manager.cc:1428] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
W20260809 22:55:03.132545 21213 tablet.cc:2369] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:03.200134 21465 raft_consensus.cc:482] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:55:03.200452 21465 raft_consensus.cc:504] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.202126 21465 leader_election.cc:288] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9578029b28d54552ae8b2a5310c49da6 (127.23.131.66:45517), 912dc275bffb4f53ac0393b2ae771ed4 (127.23.131.67:34963)
W20260809 22:55:03.209551 21422 tablet.cc:2369] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:03.211266 21441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.202729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:38743 (local address 127.23.131.66:45517)
0809 22:55:03.203112 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.203119 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.203681 (+ 562us) server_negotiation.cc:407] Connection header received
0809 22:55:03.203866 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.203871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.203951 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.204077 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:03.204868 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.206045 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.209056 (+ 3011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.210292 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.210459 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.210539 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.210821 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.210963 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260809 22:55:03.211453 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.202435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:45517 (local address 127.23.131.65:38743)
0809 22:55:03.203503 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:03.203526 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:03.203691 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:03.204107 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:03.204112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:03.204157 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:03.204698 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.204715 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.206190 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.206216 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.208883 (+ 2667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.208898 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.210512 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.210516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.210640 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.210670 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 22:55:03.210754 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 22:55:03.210855 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":152,"spinlock_wait_cycles":13440,"thread_start_us":604,"threads_started":1}
I20260809 22:55:03.211561 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.202655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:58073 (local address 127.23.131.67:34963)
0809 22:55:03.202886 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.202895 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.203633 (+ 738us) server_negotiation.cc:407] Connection header received
0809 22:55:03.203871 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.203876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.203951 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.204060 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:03.205019 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.206138 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.208932 (+ 2794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.210292 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.210459 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.210551 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.211107 (+ 556us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.211271 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:55:03.211879 21471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.202617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:34963 (local address 127.23.131.65:58073)
0809 22:55:03.203509 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:03.203526 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:03.203723 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:03.204109 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:03.204113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:03.204160 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:03.204824 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.204837 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.206270 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.206274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.208751 (+ 2477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:03.208769 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.210718 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.210723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:03.210920 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.210952 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 22:55:03.211068 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 22:55:03.211234 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"mutex_wait_us":128,"spinlock_wait_cycles":45440,"thread_start_us":587,"threads_started":1}
I20260809 22:55:03.212760 21134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d2ee70c402409da068b88e850c5d8e" candidate_uuid: "cd53860159814e31b7ccd6a060c36c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9578029b28d54552ae8b2a5310c49da6" is_pre_election: true
I20260809 22:55:03.212971 21350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d2ee70c402409da068b88e850c5d8e" candidate_uuid: "cd53860159814e31b7ccd6a060c36c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "912dc275bffb4f53ac0393b2ae771ed4" is_pre_election: true
I20260809 22:55:03.213356 21134 raft_consensus.cc:2454] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd53860159814e31b7ccd6a060c36c85 in term 0.
I20260809 22:55:03.213483 21350 raft_consensus.cc:2454] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd53860159814e31b7ccd6a060c36c85 in term 0.
I20260809 22:55:03.214149 20827 leader_election.cc:302] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 912dc275bffb4f53ac0393b2ae771ed4, 9578029b28d54552ae8b2a5310c49da6, cd53860159814e31b7ccd6a060c36c85; no voters:
I20260809 22:55:03.214581 21465 raft_consensus.cc:2781] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:55:03.214738 21465 raft_consensus.cc:482] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:55:03.214860 21465 raft_consensus.cc:3037] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:03.217294 21465 raft_consensus.cc:504] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.218000 21465 leader_election.cc:288] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9578029b28d54552ae8b2a5310c49da6 (127.23.131.66:45517), 912dc275bffb4f53ac0393b2ae771ed4 (127.23.131.67:34963)
I20260809 22:55:03.218444 21350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d2ee70c402409da068b88e850c5d8e" candidate_uuid: "cd53860159814e31b7ccd6a060c36c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "912dc275bffb4f53ac0393b2ae771ed4"
I20260809 22:55:03.218444 21134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d2ee70c402409da068b88e850c5d8e" candidate_uuid: "cd53860159814e31b7ccd6a060c36c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9578029b28d54552ae8b2a5310c49da6"
I20260809 22:55:03.218672 21350 raft_consensus.cc:3037] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:03.218672 21134 raft_consensus.cc:3037] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:03.222106 21134 raft_consensus.cc:2454] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd53860159814e31b7ccd6a060c36c85 in term 1.
I20260809 22:55:03.222119 21350 raft_consensus.cc:2454] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd53860159814e31b7ccd6a060c36c85 in term 1.
I20260809 22:55:03.222589 20827 leader_election.cc:302] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9578029b28d54552ae8b2a5310c49da6, cd53860159814e31b7ccd6a060c36c85; no voters:
I20260809 22:55:03.222918 21465 raft_consensus.cc:2781] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:03.223446 21465 raft_consensus.cc:686] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 1 LEADER]: Becoming Leader. State: Replica: cd53860159814e31b7ccd6a060c36c85, State: Running, Role: LEADER
I20260809 22:55:03.224000 21465 consensus_queue.cc:237] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } }
I20260809 22:55:03.228610 20688 catalog_manager.cc:5495] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd53860159814e31b7ccd6a060c36c85 (127.23.131.65). New cstate: current_term: 1 leader_uuid: "cd53860159814e31b7ccd6a060c36c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd53860159814e31b7ccd6a060c36c85" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260809 22:55:03.257311 21447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.251771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.23.131.65:40329)
0809 22:55:03.252008 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.252017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.252145 (+ 128us) server_negotiation.cc:407] Connection header received
0809 22:55:03.252362 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.252366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.252445 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.252572 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:55:03.252980 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.253710 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.255080 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.255534 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.255639 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.256119 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:55:03.256630 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:55:03.256760 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.256934 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.257015 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:55:03.265513 21350 raft_consensus.cc:1261] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 1 FOLLOWER]: Refusing update from remote peer cd53860159814e31b7ccd6a060c36c85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:03.265512 21134 raft_consensus.cc:1261] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 1 FOLLOWER]: Refusing update from remote peer cd53860159814e31b7ccd6a060c36c85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:03.266569 21465 consensus_queue.cc:1035] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "912dc275bffb4f53ac0393b2ae771ed4" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:03.266875 21475 consensus_queue.cc:1035] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9578029b28d54552ae8b2a5310c49da6" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 45517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:03.285882 21483 mvcc.cc:205] Tried to move back new op lower bound from 7316750758965194752 to 7316750758809620480. Current Snapshot: MvccSnapshot[applied={T|T < 7316750758965194752}]
I20260809 22:55:03.293114 20689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:03.293442 20689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:03.297853 20689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d2d83ac058b40589f0f17e061179e85: Sending DeleteTablet for 3 replicas of tablet 12d2ee70c402409da068b88e850c5d8e
I20260809 22:55:03.299185 21103 tablet_service.cc:1514] Processing DeleteTablet for tablet 12d2ee70c402409da068b88e850c5d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:03 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:52682
I20260809 22:55:03.299383 20891 tablet_service.cc:1514] Processing DeleteTablet for tablet 12d2ee70c402409da068b88e850c5d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:03 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:42056
I20260809 22:55:03.300321 21315 tablet_service.cc:1514] Processing DeleteTablet for tablet 12d2ee70c402409da068b88e850c5d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:03 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:35074
I20260809 22:55:03.301685 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 20799
I20260809 22:55:03.310439 21493 tablet_replica.cc:330] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: stopping tablet replica
I20260809 22:55:03.311143 21493 raft_consensus.cc:2229] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:03.311887 21493 raft_consensus.cc:2258] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:03.315816 21494 tablet_replica.cc:330] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: stopping tablet replica
I20260809 22:55:03.316253 21494 raft_consensus.cc:2229] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:55:03.316883 21494 raft_consensus.cc:2258] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:03.317262 21493 ts_tablet_manager.cc:1905] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:03.319350 21494 ts_tablet_manager.cc:1905] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:03.324820 21493 ts_tablet_manager.cc:1918] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:03.325023 21493 log.cc:1196] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/12d2ee70c402409da068b88e850c5d8e
I20260809 22:55:03.325634 21493 ts_tablet_manager.cc:1939] T 12d2ee70c402409da068b88e850c5d8e P 9578029b28d54552ae8b2a5310c49da6: Deleting consensus metadata
I20260809 22:55:03.327759 21494 ts_tablet_manager.cc:1918] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:03.327781 20669 catalog_manager.cc:4841] TS 9578029b28d54552ae8b2a5310c49da6 (127.23.131.66:45517): tablet 12d2ee70c402409da068b88e850c5d8e (table test-table [id=27ea4e0bb8fe464eb75bf26ce64669de]) successfully deleted
I20260809 22:55:03.328101 21494 log.cc:1196] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/12d2ee70c402409da068b88e850c5d8e
I20260809 22:55:03.328809 21494 ts_tablet_manager.cc:1939] T 12d2ee70c402409da068b88e850c5d8e P cd53860159814e31b7ccd6a060c36c85: Deleting consensus metadata
I20260809 22:55:03.330843 20668 catalog_manager.cc:4841] TS cd53860159814e31b7ccd6a060c36c85 (127.23.131.65:40329): tablet 12d2ee70c402409da068b88e850c5d8e (table test-table [id=27ea4e0bb8fe464eb75bf26ce64669de]) successfully deleted
I20260809 22:55:03.331297 21495 tablet_replica.cc:330] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: stopping tablet replica
I20260809 22:55:03.331799 21495 raft_consensus.cc:2229] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:03.332281 21495 raft_consensus.cc:2258] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:03.334594 21495 ts_tablet_manager.cc:1905] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:03.340404 21495 ts_tablet_manager.cc:1918] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:03.340616 21495 log.cc:1196] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/12d2ee70c402409da068b88e850c5d8e
Aug 09 22:55:03 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:55:03.341209 21495 ts_tablet_manager.cc:1939] T 12d2ee70c402409da068b88e850c5d8e P 912dc275bffb4f53ac0393b2ae771ed4: Deleting consensus metadata
I20260809 22:55:03.343111 20670 catalog_manager.cc:4841] TS 912dc275bffb4f53ac0393b2ae771ed4 (127.23.131.67:34963): tablet 12d2ee70c402409da068b88e850c5d8e (table test-table [id=27ea4e0bb8fe464eb75bf26ce64669de]) successfully deleted
I20260809 22:55:03.350288 21447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.303851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.23.131.65:40329)
0809 22:55:03.304682 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.304689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.328335 (+ 23646us) server_negotiation.cc:407] Connection header received
0809 22:55:03.328664 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.328672 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.328761 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.328850 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:03.332691 (+ 3841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.333890 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.335818 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.336538 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.336661 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.342517 (+ 5856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:03.342537 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:03.342558 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:03.342605 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:03.346946 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.347868 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.347879 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.347882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.348075 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.348483 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.348489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.348492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.348990 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:03.349319 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.349538 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.349888 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673}
I20260809 22:55:03.351069 20983 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:03.456050 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 20799
I20260809 22:55:03.484117 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 21003
Aug 09 22:55:03 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:55:03.501696 21441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.484955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52690 (local address 127.23.131.66:45517)
0809 22:55:03.485151 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.485157 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.485272 (+ 115us) server_negotiation.cc:407] Connection header received
0809 22:55:03.485514 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.485528 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.485603 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.485714 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:03.487110 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.487942 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.489320 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.489719 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.489861 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.495703 (+ 5842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:03.495723 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:03.495738 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:03.495778 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:03.498623 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.499453 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.499461 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.499464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.499607 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.500011 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.500016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.500021 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.500439 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:03.500787 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.501078 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.501319 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 22:55:03.502444 21201 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:03.599030 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 21003
I20260809 22:55:03.624637 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 21224
Aug 09 22:55:03 dist-test-slave-92m1 krb5kdc[20612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:55:03.640832 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:03.625572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.23.131.67:34963)
0809 22:55:03.625800 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:03.625806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:03.625828 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:55:03.626016 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:03.626022 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:03.626117 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:03.626231 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:03.627813 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.628535 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.629891 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:03.630294 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:03.630434 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:03.635242 (+ 4808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:03.635262 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:03.635286 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:03.635322 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:03.638015 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.638712 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.638719 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.638721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.638867 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:03.639261 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:03.639266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:03.639271 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:03.639608 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:03.639916 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:03.640244 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 22:55:03.640478 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 22:55:03.641546 21411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:03.731783 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 21224
I20260809 22:55:03.757572 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 20639
I20260809 22:55:03.758831 20738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:03.872676 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 20639
2026-08-09T22:55:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4989 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T22:55:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:03Z Disabled control of system clock
I20260809 22:55:03.989038 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:35943
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:42475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:35943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 22:55:04.337235 21514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:04.337600 21514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:04.337742 21514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:04.345352 21514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:04.345477 21514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:04.345584 21514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:04.345700 21514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:04.345767 21514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:04.355482 21514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:35943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:35943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:04.356987 21514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:04.358852 21514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:04.371100 21525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:04.371236 21527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:04.371280 21530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:04.371917 21514 server_base.cc:1034] running on GCE node
I20260809 22:55:04.372747 21514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:04.374095 21514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:04.375308 21514 hybrid_clock.cc:648] HybridClock initialized: now 1786316104375260 us; error 39 us; skew 500 ppm
I20260809 22:55:04.375658 21514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:04.377839 21514 webserver.cc:460] Webserver started at http://127.23.131.126:33303/ using document root <none> and password file <none>
I20260809 22:55:04.378497 21514 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:04.378623 21514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:04.378961 21514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:04.381865 21514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "bbe6dedcd5234d1f99f34979f819e149"
format_stamp: "Formatted at 2026-08-09 22:55:04 on dist-test-slave-92m1"
server_key: "72f376911620c1c5f6a7d8eaa94e4bf0"
server_key_iv: "472a863d2ff5c41edc8238eaea8d13ba"
server_key_version: "encryptionkey@0"
I20260809 22:55:04.382678 21514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "bbe6dedcd5234d1f99f34979f819e149"
format_stamp: "Formatted at 2026-08-09 22:55:04 on dist-test-slave-92m1"
server_key: "72f376911620c1c5f6a7d8eaa94e4bf0"
server_key_iv: "472a863d2ff5c41edc8238eaea8d13ba"
server_key_version: "encryptionkey@0"
I20260809 22:55:04.387831 21514 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 22:55:04.391309 21538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:04.392553 21514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:55:04.392769 21514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "bbe6dedcd5234d1f99f34979f819e149"
format_stamp: "Formatted at 2026-08-09 22:55:04 on dist-test-slave-92m1"
server_key: "72f376911620c1c5f6a7d8eaa94e4bf0"
server_key_iv: "472a863d2ff5c41edc8238eaea8d13ba"
server_key_version: "encryptionkey@0"
I20260809 22:55:04.392992 21514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:04.411573 21514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:04.412416 21514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:04.412729 21514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:04.431936 21514 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:35943
I20260809 22:55:04.431957 21620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:35943 every 8 connection(s)
I20260809 22:55:04.433306 21514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:04.435559 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 21514
I20260809 22:55:04.435746 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:04.436242 24077 external_mini_cluster.cc:1428] Setting key 58d95cbb3c0aebefdc8df2c0836461da
I20260809 22:55:04.437372 21622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:04.451159 21626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:04.438132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48362 (local address 127.23.131.126:35943)
0809 22:55:04.439166 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:04.439180 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:04.439252 (+ 72us) server_negotiation.cc:407] Connection header received
0809 22:55:04.441011 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:04.441038 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:04.441613 (+ 575us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:04.442036 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:04.442553 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:04.444657 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:04.445990 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:04.447011 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:04.447188 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:04.448392 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:04.448410 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:04.448426 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:04.449150 (+ 724us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:04.449244 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:04.449281 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:04.449401 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:04.449605 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 22:55:04.449923 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":351,"threads_started":1}
I20260809 22:55:04.452905 21622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149: Bootstrap starting.
I20260809 22:55:04.456087 21622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:04.457137 21622 log.cc:824] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:04.459806 21622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149: No bootstrap required, opened a new log
I20260809 22:55:04.467075 21622 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbe6dedcd5234d1f99f34979f819e149" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35943 } }
I20260809 22:55:04.467521 21622 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:04.467630 21622 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe6dedcd5234d1f99f34979f819e149, State: Initialized, Role: FOLLOWER
I20260809 22:55:04.468254 21622 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbe6dedcd5234d1f99f34979f819e149" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35943 } }
I20260809 22:55:04.468495 21622 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:04.468657 21622 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:04.468858 21622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:04.471151 21622 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbe6dedcd5234d1f99f34979f819e149" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35943 } }
I20260809 22:55:04.471704 21622 leader_election.cc:302] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbe6dedcd5234d1f99f34979f819e149; no voters:
I20260809 22:55:04.472340 21622 leader_election.cc:288] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:04.472481 21628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:04.473320 21628 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [term 1 LEADER]: Becoming Leader. State: Replica: bbe6dedcd5234d1f99f34979f819e149, State: Running, Role: LEADER
I20260809 22:55:04.473862 21628 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbe6dedcd5234d1f99f34979f819e149" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35943 } }
I20260809 22:55:04.474498 21622 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:04.476758 21632 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbe6dedcd5234d1f99f34979f819e149. Latest consensus state: current_term: 1 leader_uuid: "bbe6dedcd5234d1f99f34979f819e149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbe6dedcd5234d1f99f34979f819e149" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35943 } } }
I20260809 22:55:04.477182 21632 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:04.477856 21630 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbe6dedcd5234d1f99f34979f819e149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbe6dedcd5234d1f99f34979f819e149" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35943 } } }
I20260809 22:55:04.478396 21630 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:04.480471 21640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:04.486133 21640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:04.495507 21640 catalog_manager.cc:1347] Generated new cluster ID: 3cfe4286437d43af99aaf44d971c4fed
I20260809 22:55:04.495647 21640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:04.523492 21640 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:04.524813 21640 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:04.530238 21640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149: Generated new TSK 0
I20260809 22:55:04.530978 21640 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:04.538323 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35943
--builtin_ntp_servers=127.23.131.84:42475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 22:55:04.904644 21660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:04.904943 21660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:04.905040 21660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:04.912909 21660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:04.913028 21660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:04.913141 21660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:55:04.922605 21660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:04.923995 21660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:04.925845 21660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:04.939898 21668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:04.939855 21672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:04.939821 21678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:04.940557 21660 server_base.cc:1034] running on GCE node
I20260809 22:55:04.941314 21660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:04.942260 21660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:04.943495 21660 hybrid_clock.cc:648] HybridClock initialized: now 1786316104943453 us; error 53 us; skew 500 ppm
I20260809 22:55:04.943836 21660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:04.946127 21660 webserver.cc:460] Webserver started at http://127.23.131.65:36581/ using document root <none> and password file <none>
I20260809 22:55:04.946837 21660 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:04.946983 21660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:04.947373 21660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:04.950515 21660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "fd47cfe4c50a411d9a954281d0cee0af"
format_stamp: "Formatted at 2026-08-09 22:55:04 on dist-test-slave-92m1"
server_key: "271390e570d1b684ec9b73b3afaf52c6"
server_key_iv: "8b93892f10d83b5a6c6f8841e167f15f"
server_key_version: "encryptionkey@0"
I20260809 22:55:04.951399 21660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "fd47cfe4c50a411d9a954281d0cee0af"
format_stamp: "Formatted at 2026-08-09 22:55:04 on dist-test-slave-92m1"
server_key: "271390e570d1b684ec9b73b3afaf52c6"
server_key_iv: "8b93892f10d83b5a6c6f8841e167f15f"
server_key_version: "encryptionkey@0"
I20260809 22:55:04.956441 21660 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 22:55:04.959892 21689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:04.961159 21660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:55:04.961342 21660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "fd47cfe4c50a411d9a954281d0cee0af"
format_stamp: "Formatted at 2026-08-09 22:55:04 on dist-test-slave-92m1"
server_key: "271390e570d1b684ec9b73b3afaf52c6"
server_key_iv: "8b93892f10d83b5a6c6f8841e167f15f"
server_key_version: "encryptionkey@0"
I20260809 22:55:04.961570 21660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:04.982780 21660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:04.983778 21660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:04.984136 21660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:04.985229 21660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:04.986853 21660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:04.987002 21660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:04.987144 21660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:04.987267 21660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.024387 21660 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:33475
I20260809 22:55:05.024441 21871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:33475 every 8 connection(s)
I20260809 22:55:05.025882 21660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:55:05.032006 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 21660
I20260809 22:55:05.032213 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:55:05.032749 24077 external_mini_cluster.cc:1428] Setting key 0d39bacf5afb9caec6b15999858578ec
I20260809 22:55:05.035831 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35943
--builtin_ntp_servers=127.23.131.84:42475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 22:55:05.040176 21879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:05.028665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:53111 (local address 127.23.131.126:35943)
0809 22:55:05.029199 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:05.029208 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:05.030630 (+ 1422us) server_negotiation.cc:407] Connection header received
0809 22:55:05.032608 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:05.032628 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:05.032727 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:05.032848 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:05.034083 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.035049 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.036769 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.037567 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.037738 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:05.039074 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:05.039084 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:05.039091 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:05.039120 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:05.039184 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:05.039236 (+ 52us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:05.039345 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:05.039547 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 22:55:05.039669 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":268,"threads_started":1}
I20260809 22:55:05.040839 21880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:05.029341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:35943 (local address 127.23.131.65:53111)
0809 22:55:05.030431 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:05.030483 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:05.032310 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:05.033080 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:05.033088 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:05.033171 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:05.033909 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:05.033931 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.035288 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.035293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:05.036613 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:05.036625 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.037781 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.037785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:05.037984 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:05.038730 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:55:05.038733 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:05.038772 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:55:05.038851 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:05.039340 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:05.039349 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:05.039355 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:55:05.039500 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 22:55:05.039792 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":347,"threads_started":1}
I20260809 22:55:05.042382 21874 heartbeater.cc:347] Connected to a master server at 127.23.131.126:35943
I20260809 22:55:05.042692 21874 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:05.043488 21874 heartbeater.cc:511] Master 127.23.131.126:35943 requested a full tablet report, sending...
I20260809 22:55:05.045579 21570 ts_manager.cc:194] Registered new tserver with Master: fd47cfe4c50a411d9a954281d0cee0af (127.23.131.65:33475)
I20260809 22:55:05.047049 21570 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.65:53111
W20260809 22:55:05.391371 21881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:05.391633 21881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:05.391721 21881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:05.399230 21881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:05.399327 21881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:05.399441 21881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:55:05.408288 21881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:05.409528 21881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:05.411293 21881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:05.424703 21890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:05.424743 21891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:05.424768 21893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:05.425473 21881 server_base.cc:1034] running on GCE node
I20260809 22:55:05.426126 21881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:05.427024 21881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:05.428218 21881 hybrid_clock.cc:648] HybridClock initialized: now 1786316105428154 us; error 53 us; skew 500 ppm
I20260809 22:55:05.428537 21881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:05.430913 21881 webserver.cc:460] Webserver started at http://127.23.131.66:44075/ using document root <none> and password file <none>
I20260809 22:55:05.431677 21881 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:05.431807 21881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:05.432166 21881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:05.435060 21881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "cc18af1530bd4870af55db2c48c2671b"
format_stamp: "Formatted at 2026-08-09 22:55:05 on dist-test-slave-92m1"
server_key: "3bdb8db52da61f34c8f0101f04ac02a4"
server_key_iv: "4f812266eb663c001c871ffcd7aec19b"
server_key_version: "encryptionkey@0"
I20260809 22:55:05.435942 21881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "cc18af1530bd4870af55db2c48c2671b"
format_stamp: "Formatted at 2026-08-09 22:55:05 on dist-test-slave-92m1"
server_key: "3bdb8db52da61f34c8f0101f04ac02a4"
server_key_iv: "4f812266eb663c001c871ffcd7aec19b"
server_key_version: "encryptionkey@0"
I20260809 22:55:05.441043 21881 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:05.444623 21909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.445926 21881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:55:05.446096 21881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "cc18af1530bd4870af55db2c48c2671b"
format_stamp: "Formatted at 2026-08-09 22:55:05 on dist-test-slave-92m1"
server_key: "3bdb8db52da61f34c8f0101f04ac02a4"
server_key_iv: "4f812266eb663c001c871ffcd7aec19b"
server_key_version: "encryptionkey@0"
I20260809 22:55:05.446309 21881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:05.458199 21881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:05.458968 21881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:05.459399 21881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:05.460315 21881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:05.461750 21881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:05.461910 21881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.462033 21881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:05.462119 21881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.497058 21881 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:43517
I20260809 22:55:05.497112 22094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:43517 every 8 connection(s)
I20260809 22:55:05.498524 21881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:55:05.504643 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 21881
I20260809 22:55:05.504848 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:55:05.505326 24077 external_mini_cluster.cc:1428] Setting key 11f1a79f078c351ee2da3a352e86288e
I20260809 22:55:05.508312 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35943
--builtin_ntp_servers=127.23.131.84:42475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 22:55:05.513204 21879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:05.501676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:48435 (local address 127.23.131.126:35943)
0809 22:55:05.501887 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:05.501894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:05.503543 (+ 1649us) server_negotiation.cc:407] Connection header received
0809 22:55:05.505565 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:05.505571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:05.505666 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:05.505791 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:05.507025 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.507885 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.510349 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.510753 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.510847 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:05.512483 (+ 1636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:05.512488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:05.512492 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:05.512510 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:05.512543 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:05.512556 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:05.512635 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:05.512889 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 22:55:05.512968 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:55:05.514667 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:05.502372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:35943 (local address 127.23.131.66:48435)
0809 22:55:05.503384 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:05.503421 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:05.505253 (+ 1832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:05.506063 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:05.506074 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:05.506190 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:05.506816 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:05.506832 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.508060 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.508065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:05.510201 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:05.510220 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:05.510980 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:05.510989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:05.511358 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:05.512122 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:55:05.512127 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:05.512182 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:55:05.512281 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:05.512664 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:05.512678 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:05.512688 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 22:55:05.512877 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 22:55:05.513287 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":311,"threads_started":1}
I20260809 22:55:05.516098 22095 heartbeater.cc:347] Connected to a master server at 127.23.131.126:35943
I20260809 22:55:05.516402 22095 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:05.517148 22095 heartbeater.cc:511] Master 127.23.131.126:35943 requested a full tablet report, sending...
I20260809 22:55:05.518603 21570 ts_manager.cc:194] Registered new tserver with Master: cc18af1530bd4870af55db2c48c2671b (127.23.131.66:43517)
I20260809 22:55:05.519510 21570 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.66:48435
W20260809 22:55:05.871446 22098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:05.871734 22098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:05.871825 22098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:05.879140 22098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:05.879259 22098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:05.879371 22098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:55:05.888429 22098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:42475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:35943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:05.889672 22098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:05.891445 22098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:05.904901 22110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:05.904866 22107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:05.904939 22106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:05.905726 22098 server_base.cc:1034] running on GCE node
I20260809 22:55:05.906378 22098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:05.907366 22098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:05.908565 22098 hybrid_clock.cc:648] HybridClock initialized: now 1786316105908513 us; error 46 us; skew 500 ppm
I20260809 22:55:05.908880 22098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:05.911154 22098 webserver.cc:460] Webserver started at http://127.23.131.67:44965/ using document root <none> and password file <none>
I20260809 22:55:05.911891 22098 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:05.912014 22098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:05.912351 22098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:05.915267 22098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "8f7b1de11f604552993c53c7cd27b443"
format_stamp: "Formatted at 2026-08-09 22:55:05 on dist-test-slave-92m1"
server_key: "d7357bd50f57737babe7b0e11eb0ee3b"
server_key_iv: "bd53b5baaae6b2f37f3ba8c4a75da549"
server_key_version: "encryptionkey@0"
I20260809 22:55:05.916114 22098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "8f7b1de11f604552993c53c7cd27b443"
format_stamp: "Formatted at 2026-08-09 22:55:05 on dist-test-slave-92m1"
server_key: "d7357bd50f57737babe7b0e11eb0ee3b"
server_key_iv: "bd53b5baaae6b2f37f3ba8c4a75da549"
server_key_version: "encryptionkey@0"
I20260809 22:55:05.921128 22098 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 22:55:05.924787 22122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.926080 22098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:55:05.926295 22098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "8f7b1de11f604552993c53c7cd27b443"
format_stamp: "Formatted at 2026-08-09 22:55:05 on dist-test-slave-92m1"
server_key: "d7357bd50f57737babe7b0e11eb0ee3b"
server_key_iv: "bd53b5baaae6b2f37f3ba8c4a75da549"
server_key_version: "encryptionkey@0"
I20260809 22:55:05.926535 22098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:05.957012 22098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:05.957890 22098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:05.958207 22098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:05.959192 22098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:05.960713 22098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:05.960842 22098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.960981 22098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:05.961071 22098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:05.996059 22098 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:45837
I20260809 22:55:05.996150 22298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:45837 every 8 connection(s)
I20260809 22:55:05.997756 22098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:55:06.007462 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 22098
I20260809 22:55:06.007669 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:55:06.008306 24077 external_mini_cluster.cc:1428] Setting key fd1f51ff257d595181cd9acb349ac411
I20260809 22:55:06.010393 21879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.000471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:56801 (local address 127.23.131.126:35943)
0809 22:55:06.000666 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.000670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.001945 (+ 1275us) server_negotiation.cc:407] Connection header received
0809 22:55:06.003798 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.003803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.003875 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.003965 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:06.005001 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.005761 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.007344 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.007994 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.008131 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.009506 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:06.009511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:06.009515 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:06.009538 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:06.009581 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:06.009617 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:06.009713 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.009944 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.010032 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:55:06.011605 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.000889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:35943 (local address 127.23.131.67:56801)
0809 22:55:06.001786 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.001827 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:06.003558 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:06.004173 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:06.004181 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:06.004260 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:06.004838 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.004855 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.005880 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.005883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.007139 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.007151 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.008197 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.008201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.008399 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.009226 (+ 827us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:55:06.009228 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:06.009279 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:55:06.009355 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:06.009719 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:06.009729 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:06.009735 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:55:06.009891 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 22:55:06.010256 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":276,"threads_started":1}
I20260809 22:55:06.012882 22299 heartbeater.cc:347] Connected to a master server at 127.23.131.126:35943
I20260809 22:55:06.013144 22299 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:06.013839 22299 heartbeater.cc:511] Master 127.23.131.126:35943 requested a full tablet report, sending...
I20260809 22:55:06.015297 21570 ts_manager.cc:194] Registered new tserver with Master: 8f7b1de11f604552993c53c7cd27b443 (127.23.131.67:45837)
I20260809 22:55:06.016073 21570 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.67:56801
I20260809 22:55:06.024014 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:55:06.034919 21879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.028486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48374 (local address 127.23.131.126:35943)
0809 22:55:06.028877 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.028885 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.029205 (+ 320us) server_negotiation.cc:407] Connection header received
0809 22:55:06.029400 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.029406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.029492 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.029609 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:06.030106 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.030825 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.032353 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.032812 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.032960 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.034139 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:06.034145 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:06.034150 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:06.034177 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:06.034209 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:06.034221 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:06.034376 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.034582 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.034646 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260809 22:55:06.038699 21570 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:55:06.045699 21570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:55:06.050110 21874 heartbeater.cc:503] Master 127.23.131.126:35943 was elected leader, sending a full tablet report...
I20260809 22:55:06.080478 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.058843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43042 (local address 127.23.131.66:43517)
0809 22:55:06.071568 (+ 12725us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.071575 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.071600 (+ 25us) server_negotiation.cc:407] Connection header received
0809 22:55:06.071688 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.071694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.071873 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.072094 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:06.073064 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.074629 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.077540 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.079030 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.079172 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.079460 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.079903 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.080106 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12572,"thread_start_us":12455,"threads_started":1}
I20260809 22:55:06.080758 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.058679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:43517 (local address 127.0.0.1:43042)
0809 22:55:06.070620 (+ 11941us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.070679 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:06.070910 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:06.072096 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:06.072103 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:06.072134 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:06.072812 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.072833 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.074752 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.074757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.077312 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.077326 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.079250 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.079257 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.079452 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.079506 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 22:55:06.079654 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 22:55:06.080357 (+ 703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11565,"mutex_wait_us":57,"spinlock_wait_cycles":5376,"thread_start_us":13814,"threads_started":1}
I20260809 22:55:06.081362 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.059434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54656 (local address 127.23.131.67:45837)
0809 22:55:06.069601 (+ 10167us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.069615 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.072058 (+ 2443us) server_negotiation.cc:407] Connection header received
0809 22:55:06.072452 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.072464 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.072730 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.072898 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:06.073982 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.075668 (+ 1686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.078198 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.079291 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.079421 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.079757 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.080295 (+ 538us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.080476 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9894,"thread_start_us":10190,"threads_started":1}
I20260809 22:55:06.081998 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.059357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47568)
0809 22:55:06.072875 (+ 13518us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.072900 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:06.073035 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:06.073941 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:06.073948 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:06.073974 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:06.074397 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.074412 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.076345 (+ 1933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.076351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.078788 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.078804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.081116 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.081123 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.081315 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.081357 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 22:55:06.081457 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 22:55:06.081600 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13391,"mutex_wait_us":2,"thread_start_us":12233,"threads_started":1}
I20260809 22:55:06.082288 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.058709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:45837 (local address 127.0.0.1:54656)
0809 22:55:06.071889 (+ 13180us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.071912 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:06.072214 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:06.073231 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:06.073235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:06.073257 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:06.073774 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.073787 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.075846 (+ 2059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.075853 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.077971 (+ 2118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.077981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.079880 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.079887 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.080062 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.080112 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 22:55:06.081719 (+ 1607us) client_negotiation.cc:240] Negotiation successful
0809 22:55:06.081847 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13028,"mutex_wait_us":93,"spinlock_wait_cycles":896,"thread_start_us":11390,"threads_started":1}
I20260809 22:55:06.082850 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.060100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.23.131.65:33475)
0809 22:55:06.071385 (+ 11285us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.071396 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.073179 (+ 1783us) server_negotiation.cc:407] Connection header received
0809 22:55:06.073307 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.073316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.073741 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.073942 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:06.074590 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.075953 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.079003 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.080519 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.080676 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.080981 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.082397 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.082572 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11062,"thread_start_us":10930,"threads_started":1}
I20260809 22:55:06.085129 21986 tablet_service.cc:1467] Processing CreateTablet for tablet 446d628c9bb44b078beff97cc85b70fb (DEFAULT_TABLE table=test-table [id=1faffae02a704660bdeaff75c0b6c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:06.085878 21780 tablet_service.cc:1467] Processing CreateTablet for tablet 446d628c9bb44b078beff97cc85b70fb (DEFAULT_TABLE table=test-table [id=1faffae02a704660bdeaff75c0b6c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:06.086659 21986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446d628c9bb44b078beff97cc85b70fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:06.086452 22202 tablet_service.cc:1467] Processing CreateTablet for tablet 446d628c9bb44b078beff97cc85b70fb (DEFAULT_TABLE table=test-table [id=1faffae02a704660bdeaff75c0b6c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:06.087100 21780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446d628c9bb44b078beff97cc85b70fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:06.087859 22202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446d628c9bb44b078beff97cc85b70fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:06.100221 22328 tablet_bootstrap.cc:492] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: Bootstrap starting.
I20260809 22:55:06.104146 22328 tablet_bootstrap.cc:654] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:06.105244 22328 log.cc:824] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:06.107941 22332 tablet_bootstrap.cc:492] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Bootstrap starting.
I20260809 22:55:06.108410 22328 tablet_bootstrap.cc:492] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: No bootstrap required, opened a new log
I20260809 22:55:06.108707 22328 ts_tablet_manager.cc:1397] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 22:55:06.110430 22333 tablet_bootstrap.cc:492] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Bootstrap starting.
I20260809 22:55:06.111253 22332 tablet_bootstrap.cc:654] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:06.112424 22332 log.cc:824] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:06.114373 22333 tablet_bootstrap.cc:654] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:06.115691 22333 log.cc:824] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:06.116021 22332 tablet_bootstrap.cc:492] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: No bootstrap required, opened a new log
I20260809 22:55:06.116353 22332 ts_tablet_manager.cc:1397] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 22:55:06.119149 22333 tablet_bootstrap.cc:492] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: No bootstrap required, opened a new log
I20260809 22:55:06.119010 22328 raft_consensus.cc:348] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.119482 22333 ts_tablet_manager.cc:1397] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.005s
I20260809 22:55:06.119558 22328 raft_consensus.cc:374] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:06.119671 22328 raft_consensus.cc:729] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd47cfe4c50a411d9a954281d0cee0af, State: Initialized, Role: FOLLOWER
I20260809 22:55:06.120458 22328 consensus_queue.cc:260] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.124729 22332 raft_consensus.cc:348] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.125126 22332 raft_consensus.cc:374] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:06.125243 22332 raft_consensus.cc:729] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc18af1530bd4870af55db2c48c2671b, State: Initialized, Role: FOLLOWER
I20260809 22:55:06.126546 22328 ts_tablet_manager.cc:1428] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260809 22:55:06.127633 22332 consensus_queue.cc:260] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.128063 22339 raft_consensus.cc:482] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:55:06.128469 22339 raft_consensus.cc:504] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.132107 22339 leader_election.cc:288] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f7b1de11f604552993c53c7cd27b443 (127.23.131.67:45837), fd47cfe4c50a411d9a954281d0cee0af (127.23.131.65:33475)
I20260809 22:55:06.131959 22333 raft_consensus.cc:348] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.132879 22333 raft_consensus.cc:374] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:06.132939 22095 heartbeater.cc:503] Master 127.23.131.126:35943 was elected leader, sending a full tablet report...
I20260809 22:55:06.133005 22333 raft_consensus.cc:729] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f7b1de11f604552993c53c7cd27b443, State: Initialized, Role: FOLLOWER
I20260809 22:55:06.133809 22333 consensus_queue.cc:260] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.137017 22333 ts_tablet_manager.cc:1428] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Time spent starting tablet: real 0.017s user 0.012s sys 0.002s
I20260809 22:55:06.137174 22332 ts_tablet_manager.cc:1428] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Time spent starting tablet: real 0.021s user 0.012s sys 0.005s
I20260809 22:55:06.137956 22299 heartbeater.cc:503] Master 127.23.131.126:35943 was elected leader, sending a full tablet report...
I20260809 22:55:06.144881 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.132388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:37565 (local address 127.23.131.67:45837)
0809 22:55:06.132646 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.132653 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.135665 (+ 3012us) server_negotiation.cc:407] Connection header received
0809 22:55:06.137994 (+ 2329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.138001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.138084 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.138161 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:06.139094 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.140851 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.142917 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.143859 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.144092 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.144169 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.144447 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.144598 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 22:55:06.145170 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.132463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:45837 (local address 127.23.131.66:37565)
0809 22:55:06.135543 (+ 3080us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.135568 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:06.137478 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:06.138417 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:06.138423 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:06.138455 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:06.138867 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.138883 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.141009 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.141016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.142695 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.142708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.144109 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.144116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.144269 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.144293 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 22:55:06.144369 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 22:55:06.144534 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2894,"mutex_wait_us":112,"thread_start_us":6736,"threads_started":1}
I20260809 22:55:06.145385 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.134543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:33013 (local address 127.23.131.65:33475)
0809 22:55:06.134754 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.134764 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.138402 (+ 3638us) server_negotiation.cc:407] Connection header received
0809 22:55:06.138695 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.138701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.138793 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.138858 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:06.139748 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.140612 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.142971 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.143835 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.143987 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.144065 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.144938 (+ 873us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.145103 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 22:55:06.146130 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.132954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.23.131.66:33013)
0809 22:55:06.138286 (+ 5332us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.138310 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:06.138521 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:06.139061 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:06.139066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:06.139090 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:06.139570 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.139580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.140808 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.140816 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.142744 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:06.142762 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.144461 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.144472 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:06.144690 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.144728 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 22:55:06.145679 (+ 951us) client_negotiation.cc:240] Negotiation successful
0809 22:55:06.145836 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5183,"mutex_wait_us":79,"thread_start_us":2220,"threads_started":1}
I20260809 22:55:06.146296 22233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446d628c9bb44b078beff97cc85b70fb" candidate_uuid: "cc18af1530bd4870af55db2c48c2671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7b1de11f604552993c53c7cd27b443" is_pre_election: true
I20260809 22:55:06.146865 22233 raft_consensus.cc:2454] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc18af1530bd4870af55db2c48c2671b in term 0.
I20260809 22:55:06.147195 21810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446d628c9bb44b078beff97cc85b70fb" candidate_uuid: "cc18af1530bd4870af55db2c48c2671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd47cfe4c50a411d9a954281d0cee0af" is_pre_election: true
I20260809 22:55:06.147573 21916 leader_election.cc:302] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f7b1de11f604552993c53c7cd27b443, cc18af1530bd4870af55db2c48c2671b; no voters:
I20260809 22:55:06.147837 21810 raft_consensus.cc:2454] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc18af1530bd4870af55db2c48c2671b in term 0.
I20260809 22:55:06.148064 22340 raft_consensus.cc:2781] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:55:06.148234 22340 raft_consensus.cc:482] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:55:06.148442 22340 raft_consensus.cc:3037] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:06.151290 22340 raft_consensus.cc:504] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.151991 22340 leader_election.cc:288] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [CANDIDATE]: Term 1 election: Requested vote from peers 8f7b1de11f604552993c53c7cd27b443 (127.23.131.67:45837), fd47cfe4c50a411d9a954281d0cee0af (127.23.131.65:33475)
I20260809 22:55:06.152436 22233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446d628c9bb44b078beff97cc85b70fb" candidate_uuid: "cc18af1530bd4870af55db2c48c2671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f7b1de11f604552993c53c7cd27b443"
I20260809 22:55:06.152508 21810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446d628c9bb44b078beff97cc85b70fb" candidate_uuid: "cc18af1530bd4870af55db2c48c2671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd47cfe4c50a411d9a954281d0cee0af"
I20260809 22:55:06.152702 22233 raft_consensus.cc:3037] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:06.152729 21810 raft_consensus.cc:3037] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:06.156251 21810 raft_consensus.cc:2454] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc18af1530bd4870af55db2c48c2671b in term 1.
I20260809 22:55:06.156251 22233 raft_consensus.cc:2454] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc18af1530bd4870af55db2c48c2671b in term 1.
I20260809 22:55:06.156721 21912 leader_election.cc:302] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc18af1530bd4870af55db2c48c2671b, fd47cfe4c50a411d9a954281d0cee0af; no voters:
I20260809 22:55:06.157079 22340 raft_consensus.cc:2781] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:06.157313 22340 raft_consensus.cc:686] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 1 LEADER]: Becoming Leader. State: Replica: cc18af1530bd4870af55db2c48c2671b, State: Running, Role: LEADER
I20260809 22:55:06.157877 22340 consensus_queue.cc:237] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } }
I20260809 22:55:06.162878 21570 catalog_manager.cc:5495] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b reported cstate change: term changed from 0 to 1, leader changed from <none> to cc18af1530bd4870af55db2c48c2671b (127.23.131.66). New cstate: current_term: 1 leader_uuid: "cc18af1530bd4870af55db2c48c2671b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc18af1530bd4870af55db2c48c2671b" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 43517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260809 22:55:06.193908 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.188708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43050 (local address 127.23.131.66:43517)
0809 22:55:06.188907 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.188912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.188930 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:55:06.189132 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.189136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.189228 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.189357 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:55:06.189723 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.190437 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.191861 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.192272 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.192366 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.192883 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:55:06.193381 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:55:06.193507 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.193652 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.193691 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:55:06.202773 22233 raft_consensus.cc:1261] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 1 FOLLOWER]: Refusing update from remote peer cc18af1530bd4870af55db2c48c2671b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:06.202771 21810 raft_consensus.cc:1261] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 1 FOLLOWER]: Refusing update from remote peer cc18af1530bd4870af55db2c48c2671b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:06.204078 22340 consensus_queue.cc:1035] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd47cfe4c50a411d9a954281d0cee0af" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:06.204465 22339 consensus_queue.cc:1035] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f7b1de11f604552993c53c7cd27b443" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 45837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:06.222584 22354 mvcc.cc:205] Tried to move back new op lower bound from 7316750770995507200 to 7316750770827014144. Current Snapshot: MvccSnapshot[applied={T|T < 7316750770995507200}]
I20260809 22:55:06.232370 21567 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:06.232645 21567 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:06.236462 21567 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbe6dedcd5234d1f99f34979f819e149: Sending DeleteTablet for 3 replicas of tablet 446d628c9bb44b078beff97cc85b70fb
I20260809 22:55:06.237823 21986 tablet_service.cc:1514] Processing DeleteTablet for tablet 446d628c9bb44b078beff97cc85b70fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:06 UTC) from {username='slave'} at 127.0.0.1:43042
I20260809 22:55:06.237872 22202 tablet_service.cc:1514] Processing DeleteTablet for tablet 446d628c9bb44b078beff97cc85b70fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:06 UTC) from {username='slave'} at 127.0.0.1:54656
I20260809 22:55:06.237897 21780 tablet_service.cc:1514] Processing DeleteTablet for tablet 446d628c9bb44b078beff97cc85b70fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:06 UTC) from {username='slave'} at 127.0.0.1:47568
I20260809 22:55:06.240710 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 21660
I20260809 22:55:06.252369 22372 tablet_replica.cc:330] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: stopping tablet replica
I20260809 22:55:06.252925 22372 raft_consensus.cc:2229] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:06.253563 22372 raft_consensus.cc:2258] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:06.254522 22371 tablet_replica.cc:330] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: stopping tablet replica
I20260809 22:55:06.254949 22371 raft_consensus.cc:2229] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:06.255488 22371 raft_consensus.cc:2258] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:06.256628 22370 tablet_replica.cc:330] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: stopping tablet replica
I20260809 22:55:06.257069 22370 raft_consensus.cc:2229] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:55:06.257813 22370 raft_consensus.cc:2258] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:06.258191 22371 ts_tablet_manager.cc:1905] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:06.258909 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.242164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47578 (local address 127.23.131.65:33475)
0809 22:55:06.242353 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.242359 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.246406 (+ 4047us) server_negotiation.cc:407] Connection header received
0809 22:55:06.247644 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.247654 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.247842 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.247952 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:06.249631 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.250910 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.254407 (+ 3497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.255094 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.255235 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.256964 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:06.256978 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:06.256995 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:06.257796 (+ 801us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:06.257863 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:06.257893 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:06.258002 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.258297 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.258440 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 22:55:06.259531 22372 ts_tablet_manager.cc:1905] T 446d628c9bb44b078beff97cc85b70fb P fd47cfe4c50a411d9a954281d0cee0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:06.260247 21864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:06.263129 22370 ts_tablet_manager.cc:1905] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:06.266017 22371 ts_tablet_manager.cc:1918] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:06.266265 22371 log.cc:1196] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/446d628c9bb44b078beff97cc85b70fb
I20260809 22:55:06.266919 22371 ts_tablet_manager.cc:1939] T 446d628c9bb44b078beff97cc85b70fb P 8f7b1de11f604552993c53c7cd27b443: Deleting consensus metadata
I20260809 22:55:06.268985 21544 catalog_manager.cc:4841] TS 8f7b1de11f604552993c53c7cd27b443 (127.23.131.67:45837): tablet 446d628c9bb44b078beff97cc85b70fb (table test-table [id=1faffae02a704660bdeaff75c0b6c51d]) successfully deleted
I20260809 22:55:06.274377 22370 ts_tablet_manager.cc:1918] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:06.274585 22370 log.cc:1196] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/446d628c9bb44b078beff97cc85b70fb
I20260809 22:55:06.275266 22370 ts_tablet_manager.cc:1939] T 446d628c9bb44b078beff97cc85b70fb P cc18af1530bd4870af55db2c48c2671b: Deleting consensus metadata
I20260809 22:55:06.277067 21546 catalog_manager.cc:4841] TS cc18af1530bd4870af55db2c48c2671b (127.23.131.66:43517): tablet 446d628c9bb44b078beff97cc85b70fb (table test-table [id=1faffae02a704660bdeaff75c0b6c51d]) successfully deleted
I20260809 22:55:06.375429 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 21660
I20260809 22:55:06.404960 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 21881
W20260809 22:55:06.404891 21540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:33475 (error 108)
I20260809 22:55:06.406893 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.406389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47582)
0809 22:55:06.406558 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.406708 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 22:55:06.407117 21540 catalog_manager.cc:4584] TS fd47cfe4c50a411d9a954281d0cee0af (127.23.131.65:33475): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 446d628c9bb44b078beff97cc85b70fb: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
I20260809 22:55:06.414091 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.406124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43066 (local address 127.23.131.66:43517)
0809 22:55:06.406306 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.406310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.406328 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:55:06.406690 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.406695 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.406810 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.406947 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:06.407909 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.408690 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.410737 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.411181 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.411424 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.412550 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:06.412558 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:06.412572 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:06.413238 (+ 666us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:06.413291 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:06.413314 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:06.413413 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.413601 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.413684 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:55:06.414871 22084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:06.460789 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.460284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47588)
0809 22:55:06.460511 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.460628 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 22:55:06.461848 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.461483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47590)
0809 22:55:06.461655 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.461739 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 22:55:06.522542 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.522032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47594)
0809 22:55:06.522258 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.522358 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 22:55:06.523641 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.523296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47602)
0809 22:55:06.523447 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.523523 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 22:55:06.533788 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 21881
I20260809 22:55:06.563946 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 22098
I20260809 22:55:06.575613 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.564755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54666 (local address 127.23.131.67:45837)
0809 22:55:06.564954 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:06.564963 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:06.564986 (+ 23us) server_negotiation.cc:407] Connection header received
0809 22:55:06.565218 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:06.565229 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:06.565316 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:06.565430 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:06.565872 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.566612 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.568062 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:06.568498 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:06.568653 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:06.574097 (+ 5444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:06.574107 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:06.574122 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:06.574753 (+ 631us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:06.574805 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:06.574826 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:06.574973 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:06.575110 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 22:55:06.575252 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 22:55:06.576372 22294 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:06.604260 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.603776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47614)
0809 22:55:06.603996 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.604082 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 22:55:06.605449 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.605054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47620)
0809 22:55:06.605263 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.605335 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 22:55:06.668581 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 22098
I20260809 22:55:06.695046 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 21514
I20260809 22:55:06.696214 21614 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:06.830559 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:06.829766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:33475 (local address 127.0.0.1:47628)
0809 22:55:06.830084 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:06.830176 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:33475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260809 22:55:06.830551 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 21514
2026-08-09T22:55:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2959 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:06 dist-test-slave-92m1 krb5kdc[22384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:06 dist-test-slave-92m1 krb5kdc[22384](info): set up 2 sockets
Aug 09 22:55:06 dist-test-slave-92m1 krb5kdc[22384](info): commencing operation
krb5kdc: starting...
W20260809 22:55:08.216500 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:08 dist-test-slave-92m1 krb5kdc[22384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:08.614609 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45207
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:08.976070 22401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:08.976384 22401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:08.976552 22401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:08.983940 22401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:08.984072 22401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:08.984179 22401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:08.984277 22401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:08.984342 22401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:08.994340 22401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:08.995746 22401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:08.997062 22401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:09.009691 22412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:09.009652 22413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:09.009668 22417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:09.010274 22401 server_base.cc:1034] running on GCE node
I20260809 22:55:09.011370 22401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:09.012857 22401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:09.014096 22401 hybrid_clock.cc:648] HybridClock initialized: now 1786316109014041 us; error 54 us; skew 500 ppm
I20260809 22:55:09.014454 22401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:09 dist-test-slave-92m1 krb5kdc[22384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316109, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:09.017650 22401 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:09.019306 22401 webserver.cc:460] Webserver started at http://127.23.131.126:33281/ using document root <none> and password file <none>
I20260809 22:55:09.020001 22401 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:09.020159 22401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:09.020474 22401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:09.023578 22401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "51c0ad59fa814b3f98b59e386e37eb7d"
format_stamp: "Formatted at 2026-08-09 22:55:09 on dist-test-slave-92m1"
server_key: "5930343eef710b328357bc9c235cbac8"
server_key_iv: "34dada0fcc0ce70fbcc8937e62092072"
server_key_version: "encryptionkey@0"
I20260809 22:55:09.024351 22401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "51c0ad59fa814b3f98b59e386e37eb7d"
format_stamp: "Formatted at 2026-08-09 22:55:09 on dist-test-slave-92m1"
server_key: "5930343eef710b328357bc9c235cbac8"
server_key_iv: "34dada0fcc0ce70fbcc8937e62092072"
server_key_version: "encryptionkey@0"
I20260809 22:55:09.029784 22401 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:09.033380 22426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:09.034641 22401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:09.034816 22401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "51c0ad59fa814b3f98b59e386e37eb7d"
format_stamp: "Formatted at 2026-08-09 22:55:09 on dist-test-slave-92m1"
server_key: "5930343eef710b328357bc9c235cbac8"
server_key_iv: "34dada0fcc0ce70fbcc8937e62092072"
server_key_version: "encryptionkey@0"
I20260809 22:55:09.034999 22401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:09.053311 22401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:09.057927 22401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:09.058285 22401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:09.080318 22401 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:45207
I20260809 22:55:09.080343 22506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:45207 every 8 connection(s)
I20260809 22:55:09.081817 22401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:09.082886 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 22401
I20260809 22:55:09.083138 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:09.083722 24077 external_mini_cluster.cc:1428] Setting key 731a1e14c55b2118a97d96b6097690e2
I20260809 22:55:09.086915 22507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:55:09 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:09.098346 22507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d: Bootstrap starting.
I20260809 22:55:09.101857 22507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:09.102990 22507 log.cc:824] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:09.106113 22507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d: No bootstrap required, opened a new log
I20260809 22:55:09.107064 22510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:09.085710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47074 (local address 127.23.131.126:45207)
0809 22:55:09.086618 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:09.086630 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:09.086671 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:55:09.088490 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:09.088512 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:09.088885 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:09.089265 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:09.090810 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:09.092278 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:09.093645 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:09.094360 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:09.094593 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:09.099350 (+ 4757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:09.099358 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:09.099373 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:09.099415 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:09.102684 (+ 3269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:09.103540 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:09.103548 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:09.103554 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:09.103754 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:09.104199 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:09.104204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:09.104214 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:09.104752 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:09.105077 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:09.105559 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 22:55:09.106016 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":365,"threads_started":1}
I20260809 22:55:09.115067 22507 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45207 } }
I20260809 22:55:09.115619 22507 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:09.115741 22507 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c0ad59fa814b3f98b59e386e37eb7d, State: Initialized, Role: FOLLOWER
I20260809 22:55:09.116431 22507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45207 } }
I20260809 22:55:09.116720 22507 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:09.116880 22507 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:09.117061 22507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:09.119475 22507 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45207 } }
I20260809 22:55:09.120105 22507 leader_election.cc:302] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51c0ad59fa814b3f98b59e386e37eb7d; no voters:
I20260809 22:55:09.120860 22507 leader_election.cc:288] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:09.120987 22512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:09.121671 22512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [term 1 LEADER]: Becoming Leader. State: Replica: 51c0ad59fa814b3f98b59e386e37eb7d, State: Running, Role: LEADER
I20260809 22:55:09.122375 22512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45207 } }
I20260809 22:55:09.123838 22507 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:09.125574 22513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51c0ad59fa814b3f98b59e386e37eb7d. Latest consensus state: current_term: 1 leader_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45207 } } }
I20260809 22:55:09.126173 22513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:09.126030 22514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51c0ad59fa814b3f98b59e386e37eb7d" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45207 } } }
I20260809 22:55:09.126909 22514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:09.128248 22519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:09.133931 22519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:09.142936 22519 catalog_manager.cc:1347] Generated new cluster ID: b65bce41e57742fb9d90fa5ff37c751e
I20260809 22:55:09.143039 22519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:09.177034 22519 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:09.179152 22519 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:09.189867 22519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d: Generated new TSK 0
I20260809 22:55:09.190943 22519 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.131.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
Entry for principal kudu/127.23.131.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab.
I20260809 22:55:09.276571 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45207
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:09.637821 22547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:09.638136 22547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:09.638247 22547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:09.645642 22547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:09.645756 22547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:09.645884 22547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:55:09.655567 22547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.65.keytab
--principal=kudu/127.23.131.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:09.656881 22547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:09.658135 22547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:09.671550 22553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:09.671645 22556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:09.671666 22554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:09.672575 22547 server_base.cc:1034] running on GCE node
I20260809 22:55:09.673271 22547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:09.674280 22547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:09.675521 22547 hybrid_clock.cc:648] HybridClock initialized: now 1786316109675463 us; error 51 us; skew 500 ppm
I20260809 22:55:09.675841 22547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:09 dist-test-slave-92m1 krb5kdc[22384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316109, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:09.679087 22547 init.cc:377] Logged in from keytab as kudu/127.23.131.65@KRBTEST.COM (short username kudu)
I20260809 22:55:09.680603 22547 webserver.cc:460] Webserver started at http://127.23.131.65:46811/ using document root <none> and password file <none>
I20260809 22:55:09.681313 22547 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:09.681468 22547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:09.681800 22547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:09.685495 22547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "371ff233cc3847afa1c2209c4aec8fe3"
format_stamp: "Formatted at 2026-08-09 22:55:09 on dist-test-slave-92m1"
server_key: "f2777d87a0aeaf2ba25bac9011368db2"
server_key_iv: "5b671189f759bbbb2e0db31e13b8cf19"
server_key_version: "encryptionkey@0"
I20260809 22:55:09.686378 22547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "371ff233cc3847afa1c2209c4aec8fe3"
format_stamp: "Formatted at 2026-08-09 22:55:09 on dist-test-slave-92m1"
server_key: "f2777d87a0aeaf2ba25bac9011368db2"
server_key_iv: "5b671189f759bbbb2e0db31e13b8cf19"
server_key_version: "encryptionkey@0"
I20260809 22:55:09.692273 22547 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:55:09.696286 22565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:09.697705 22547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:55:09.697904 22547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "371ff233cc3847afa1c2209c4aec8fe3"
format_stamp: "Formatted at 2026-08-09 22:55:09 on dist-test-slave-92m1"
server_key: "f2777d87a0aeaf2ba25bac9011368db2"
server_key_iv: "5b671189f759bbbb2e0db31e13b8cf19"
server_key_version: "encryptionkey@0"
I20260809 22:55:09.698146 22547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:09.716568 22547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:09.720606 22547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:09.720924 22547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:09.721917 22547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:09.723371 22547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:09.723483 22547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:09.723641 22547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:09.723716 22547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:09.758754 22547 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:39611
I20260809 22:55:09.758800 22736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:39611 every 8 connection(s)
I20260809 22:55:09.760111 22547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:55:09.764875 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 22547
I20260809 22:55:09.765105 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:55:09.765691 24077 external_mini_cluster.cc:1428] Setting key d85d57ad8a848501887186ba3b1ca798
Aug 09 22:55:09 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316109, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.65@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:09.782586 22739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:09.762785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:36851 (local address 127.23.131.126:45207)
0809 22:55:09.763338 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:09.763343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:09.764118 (+ 775us) server_negotiation.cc:407] Connection header received
0809 22:55:09.766684 (+ 2566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:09.766691 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:09.766783 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:09.766902 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:09.768772 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:09.769484 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:09.771991 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:09.772368 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:09.772473 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:09.776758 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:09.776763 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:09.776766 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:09.776798 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:09.779468 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:09.780223 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:09.780230 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:09.780239 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:09.780370 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:09.780828 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:09.780833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:09.780835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:09.781097 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:09.781257 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:09.781949 (+ 692us) server_negotiation.cc:299] Negotiation successful
0809 22:55:09.782188 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":265,"threads_started":1}
I20260809 22:55:09.783643 22740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:09.763227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45207 (local address 127.23.131.65:36851)
0809 22:55:09.763946 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:09.763989 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:09.766390 (+ 2401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:09.767165 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:09.767173 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:09.767737 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:09.768583 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:09.768609 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:09.769653 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:09.769661 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:09.771839 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:09.771857 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:09.772606 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:09.772633 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:09.772959 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:09.773740 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:55:09.773780 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:09.776492 (+ 2712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:09.779615 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:09.779623 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:09.779639 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:09.780089 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:09.780482 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:09.780489 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:09.780493 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:09.780682 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:09.781231 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:09.781239 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:09.781574 (+ 335us) client_negotiation.cc:769] Sending connection context
0809 22:55:09.781839 (+ 265us) client_negotiation.cc:240] Negotiation successful
0809 22:55:09.782387 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":290,"threads_started":1}
I20260809 22:55:09.785338 22737 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45207
I20260809 22:55:09.785655 22737 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:09.786419 22737 heartbeater.cc:511] Master 127.23.131.126:45207 requested a full tablet report, sending...
I20260809 22:55:09.788605 22449 ts_manager.cc:194] Registered new tserver with Master: 371ff233cc3847afa1c2209c4aec8fe3 (127.23.131.65:39611)
I20260809 22:55:09.790017 22449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.65@KRBTEST.COM'} at 127.23.131.65:36851
WARNING: no policy specified for kudu/127.23.131.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
Entry for principal kudu/127.23.131.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab.
I20260809 22:55:09.850387 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45207
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:10.215370 22744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:10.215698 22744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:10.215879 22744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:10.223873 22744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:10.224036 22744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:10.224227 22744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:55:10.234261 22744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.66.keytab
--principal=kudu/127.23.131.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:10.235574 22744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:10.236855 22744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:10.250108 22751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:10.250074 22752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:10.250172 22755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:10.251492 22744 server_base.cc:1034] running on GCE node
I20260809 22:55:10.252106 22744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:10.253077 22744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:10.254278 22744 hybrid_clock.cc:648] HybridClock initialized: now 1786316110254238 us; error 28 us; skew 500 ppm
I20260809 22:55:10.254591 22744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:10 dist-test-slave-92m1 krb5kdc[22384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316110, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:10.257814 22744 init.cc:377] Logged in from keytab as kudu/127.23.131.66@KRBTEST.COM (short username kudu)
I20260809 22:55:10.259155 22744 webserver.cc:460] Webserver started at http://127.23.131.66:43919/ using document root <none> and password file <none>
I20260809 22:55:10.259840 22744 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:10.259946 22744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:10.260219 22744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:10.263172 22744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "4cdbd89ebbf949cda033368b6b9bd705"
format_stamp: "Formatted at 2026-08-09 22:55:10 on dist-test-slave-92m1"
server_key: "7241e52b67f5730167aa175c744fb540"
server_key_iv: "247ebd415d2a1af6a71d2849a11b9280"
server_key_version: "encryptionkey@0"
I20260809 22:55:10.263954 22744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "4cdbd89ebbf949cda033368b6b9bd705"
format_stamp: "Formatted at 2026-08-09 22:55:10 on dist-test-slave-92m1"
server_key: "7241e52b67f5730167aa175c744fb540"
server_key_iv: "247ebd415d2a1af6a71d2849a11b9280"
server_key_version: "encryptionkey@0"
I20260809 22:55:10.269160 22744 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:10.272483 22764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:10.273882 22744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:55:10.274056 22744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "4cdbd89ebbf949cda033368b6b9bd705"
format_stamp: "Formatted at 2026-08-09 22:55:10 on dist-test-slave-92m1"
server_key: "7241e52b67f5730167aa175c744fb540"
server_key_iv: "247ebd415d2a1af6a71d2849a11b9280"
server_key_version: "encryptionkey@0"
I20260809 22:55:10.274245 22744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:10.301854 22744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:10.306193 22744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:10.306502 22744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:10.307570 22744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:10.309005 22744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:10.309077 22744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:10.309249 22744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:10.309300 22744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:10.344897 22744 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:46313
I20260809 22:55:10.344951 22947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:46313 every 8 connection(s)
I20260809 22:55:10.346210 22744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:55:10.349182 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 22744
I20260809 22:55:10.349406 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:55:10.349855 24077 external_mini_cluster.cc:1428] Setting key 586bcf014ddf592b4d803d765e659f6a
Aug 09 22:55:10 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316110, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.66@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:10.368666 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.348875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:53455 (local address 127.23.131.126:45207)
0809 22:55:10.349380 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:10.349386 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:10.350514 (+ 1128us) server_negotiation.cc:407] Connection header received
0809 22:55:10.352754 (+ 2240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:10.352760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:10.352852 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:10.352972 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:10.354465 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.355663 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.357209 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.357918 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.358056 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:10.361613 (+ 3557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:10.361622 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:10.361629 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:10.361675 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:10.365264 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:10.366013 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:10.366019 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:10.366023 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:10.366187 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:10.366598 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:10.366605 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:10.366610 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:10.366990 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:10.367163 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:10.367879 (+ 716us) server_negotiation.cc:299] Negotiation successful
0809 22:55:10.368138 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":258,"threads_started":1}
I20260809 22:55:10.369344 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.349421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45207 (local address 127.23.131.66:53455)
0809 22:55:10.350323 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:10.350375 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:10.352479 (+ 2104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:10.353232 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:10.353239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:10.353728 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:10.354289 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:10.354306 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.355826 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.355830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:10.357054 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:10.357067 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.358123 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.358128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:10.358314 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:10.359021 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:55:10.359043 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:10.361376 (+ 2333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:10.365438 (+ 4062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:10.365445 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:10.365457 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:10.365893 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:10.366301 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:10.366304 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:10.366306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:10.366486 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:10.367118 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:10.367124 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:10.367514 (+ 390us) client_negotiation.cc:769] Sending connection context
0809 22:55:10.367749 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 22:55:10.368161 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":353,"threads_started":1}
I20260809 22:55:10.370939 22948 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45207
I20260809 22:55:10.371326 22948 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:10.372087 22948 heartbeater.cc:511] Master 127.23.131.126:45207 requested a full tablet report, sending...
I20260809 22:55:10.373668 22449 ts_manager.cc:194] Registered new tserver with Master: 4cdbd89ebbf949cda033368b6b9bd705 (127.23.131.66:46313)
I20260809 22:55:10.374513 22449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.66@KRBTEST.COM'} at 127.23.131.66:53455
WARNING: no policy specified for kudu/127.23.131.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
Entry for principal kudu/127.23.131.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab.
I20260809 22:55:10.430827 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45207
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:10.787058 22955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:10.787456 22955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:10.787571 22955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 22:55:10.793009 22737 heartbeater.cc:503] Master 127.23.131.126:45207 was elected leader, sending a full tablet report...
W20260809 22:55:10.795761 22955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:10.795871 22955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:10.796005 22955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:55:10.806380 22955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.67.keytab
--principal=kudu/127.23.131.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:45207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:10.807914 22955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:10.809213 22955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:10.822736 22974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:10.822779 22970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:10.822726 22979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:10.824216 22955 server_base.cc:1034] running on GCE node
I20260809 22:55:10.824920 22955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:10.826023 22955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:10.827289 22955 hybrid_clock.cc:648] HybridClock initialized: now 1786316110827235 us; error 39 us; skew 500 ppm
I20260809 22:55:10.827623 22955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:10 dist-test-slave-92m1 krb5kdc[22384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316110, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:10.831319 22955 init.cc:377] Logged in from keytab as kudu/127.23.131.67@KRBTEST.COM (short username kudu)
I20260809 22:55:10.832837 22955 webserver.cc:460] Webserver started at http://127.23.131.67:46503/ using document root <none> and password file <none>
I20260809 22:55:10.833637 22955 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:10.833789 22955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:10.834121 22955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:10.837138 22955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "cd81ddd383e34331908708804bf6dcda"
format_stamp: "Formatted at 2026-08-09 22:55:10 on dist-test-slave-92m1"
server_key: "109dc883205039a2e8d8bd839c790ac7"
server_key_iv: "b731422e2011999d1e9430e490f823bf"
server_key_version: "encryptionkey@0"
I20260809 22:55:10.837939 22955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "cd81ddd383e34331908708804bf6dcda"
format_stamp: "Formatted at 2026-08-09 22:55:10 on dist-test-slave-92m1"
server_key: "109dc883205039a2e8d8bd839c790ac7"
server_key_iv: "b731422e2011999d1e9430e490f823bf"
server_key_version: "encryptionkey@0"
I20260809 22:55:10.843398 22955 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 22:55:10.847545 22988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:10.848884 22955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:55:10.849057 22955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "cd81ddd383e34331908708804bf6dcda"
format_stamp: "Formatted at 2026-08-09 22:55:10 on dist-test-slave-92m1"
server_key: "109dc883205039a2e8d8bd839c790ac7"
server_key_iv: "b731422e2011999d1e9430e490f823bf"
server_key_version: "encryptionkey@0"
I20260809 22:55:10.849251 22955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:10.870721 22955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:10.875293 22955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:10.875608 22955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:10.876688 22955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:10.878191 22955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:10.878266 22955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:10.878450 22955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:10.878518 22955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:10.914037 22955 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:43267
I20260809 22:55:10.914115 23181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:43267 every 8 connection(s)
I20260809 22:55:10.915477 22955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:55:10.918960 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 22955
I20260809 22:55:10.919171 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:55:10.919711 24077 external_mini_cluster.cc:1428] Setting key 3ab7e2a90a7a1388c2f297a9b65320ed
Aug 09 22:55:10 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316110, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.67@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:10.936213 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.918003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:38937 (local address 127.23.131.126:45207)
0809 22:55:10.918513 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:10.918518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:10.919472 (+ 954us) server_negotiation.cc:407] Connection header received
0809 22:55:10.921847 (+ 2375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:10.921852 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:10.921961 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:10.922084 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:10.923726 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.924513 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.926090 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.926515 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.926609 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:10.930110 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:10.930115 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:10.930118 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:10.930151 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:10.932753 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:10.933627 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:10.933633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:10.933636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:10.933816 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:10.934362 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:10.934367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:10.934370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:10.934736 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:10.934901 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:10.935729 (+ 828us) server_negotiation.cc:299] Negotiation successful
0809 22:55:10.935923 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":266,"threads_started":1}
I20260809 22:55:10.937144 23186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.918404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45207 (local address 127.23.131.67:38937)
0809 22:55:10.919299 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:10.919347 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:10.921563 (+ 2216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:10.922281 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:10.922289 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:10.922902 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:10.923550 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:10.923568 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.924700 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.924703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:10.925969 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:10.925981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.926702 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.926706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:10.926900 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:10.927591 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:55:10.927618 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:10.929920 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:10.932914 (+ 2994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:10.932923 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:10.932940 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:10.933463 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:10.933951 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:55:10.933955 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:55:10.933958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:55:10.934227 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:55:10.934899 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:10.934909 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:10.935379 (+ 470us) client_negotiation.cc:769] Sending connection context
0809 22:55:10.935613 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 22:55:10.936016 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":395,"threads_started":1}
I20260809 22:55:10.938509 23183 heartbeater.cc:347] Connected to a master server at 127.23.131.126:45207
I20260809 22:55:10.938843 23183 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:10.939662 23183 heartbeater.cc:511] Master 127.23.131.126:45207 requested a full tablet report, sending...
I20260809 22:55:10.941098 22449 ts_manager.cc:194] Registered new tserver with Master: cd81ddd383e34331908708804bf6dcda (127.23.131.67:43267)
I20260809 22:55:10.941910 22449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.131.67@KRBTEST.COM'} at 127.23.131.67:38937
I20260809 22:55:10.947427 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:55:10.964206 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.951763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47086 (local address 127.23.131.126:45207)
0809 22:55:10.952010 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:10.952017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:10.952284 (+ 267us) server_negotiation.cc:407] Connection header received
0809 22:55:10.952479 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:10.952483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:10.952570 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:10.952667 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:10.954264 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.955003 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.956331 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:10.956755 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:10.956850 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:10.959188 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:10.959193 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:10.959196 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:10.959293 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:10.961702 (+ 2409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:10.962303 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:10.962307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:10.962309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:10.962425 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:10.962817 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:10.962820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:10.962822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:10.963123 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:10.963369 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:10.963677 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 22:55:10.963847 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 22:55:10.968137 22449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:55:10.975095 22449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:55:11.017176 23203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.987702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:46313 (local address 127.0.0.1:41368)
0809 22:55:11.003931 (+ 16229us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:11.003995 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:11.004226 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:11.009663 (+ 5437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:11.009671 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:11.009721 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:11.010116 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.010130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.012247 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.012253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.014145 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.014158 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.015938 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.015944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.016151 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.016243 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 22:55:11.016394 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 22:55:11.016627 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15926,"mutex_wait_us":4,"thread_start_us":15723,"threads_started":1}
I20260809 22:55:11.017302 23207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.988517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42702 (local address 127.23.131.65:39611)
0809 22:55:11.008618 (+ 20101us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.008629 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.008662 (+ 33us) server_negotiation.cc:407] Connection header received
0809 22:55:11.008772 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.008778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.009026 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.009241 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:11.010009 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.011668 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.014581 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.016114 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.016262 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.016517 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.016741 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.016954 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19894,"thread_start_us":19719,"threads_started":1}
I20260809 22:55:11.017223 23208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.987956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39611 (local address 127.0.0.1:42702)
0809 22:55:11.005053 (+ 17097us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:11.005087 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:11.005238 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:11.009281 (+ 4043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:11.009287 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:11.009316 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:11.009787 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.009803 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.011821 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.011826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.014378 (+ 2552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.014394 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.016341 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.016350 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.016533 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.016563 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 22:55:11.016651 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 22:55:11.016791 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16894,"mutex_wait_us":76,"thread_start_us":18300,"threads_started":1}
I20260809 22:55:11.018525 23206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.989667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:43267 (local address 127.0.0.1:52824)
0809 22:55:11.006595 (+ 16928us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:11.006624 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:11.006780 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:11.008100 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:11.008111 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:11.008159 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:11.008630 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.008646 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.011531 (+ 2885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.011537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.014378 (+ 2841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.014394 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.017629 (+ 3235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.017635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.017838 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.017872 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 22:55:11.017978 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 22:55:11.018115 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16767,"mutex_wait_us":54,"thread_start_us":14981,"threads_started":1}
I20260809 22:55:11.018740 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.987957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41368 (local address 127.23.131.66:46313)
0809 22:55:11.008960 (+ 21003us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.008968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.008996 (+ 28us) server_negotiation.cc:407] Connection header received
0809 22:55:11.009090 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.009097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.009343 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.010320 (+ 977us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:11.010610 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.012099 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.014352 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.015702 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.015866 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.016114 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.017773 (+ 1659us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.017984 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20842,"thread_start_us":20703,"threads_started":1}
I20260809 22:55:11.019225 23209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:10.990544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52824 (local address 127.23.131.67:43267)
0809 22:55:11.006015 (+ 15471us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.006028 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.006935 (+ 907us) server_negotiation.cc:407] Connection header received
0809 22:55:11.007069 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.007081 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.007427 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.007691 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:11.008869 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.011396 (+ 2527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.014584 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.016110 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.017224 (+ 1114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.017479 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.018064 (+ 585us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.018228 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15208,"thread_start_us":15007,"threads_started":1}
I20260809 22:55:11.022018 22842 tablet_service.cc:1467] Processing CreateTablet for tablet 92191057dfa04eb3a8a0683ebd3b65e7 (DEFAULT_TABLE table=test-table [id=6f100d57e5394b3089e1d3ccfe672c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:11.022050 22639 tablet_service.cc:1467] Processing CreateTablet for tablet 92191057dfa04eb3a8a0683ebd3b65e7 (DEFAULT_TABLE table=test-table [id=6f100d57e5394b3089e1d3ccfe672c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:11.023447 22842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92191057dfa04eb3a8a0683ebd3b65e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:11.022933 23071 tablet_service.cc:1467] Processing CreateTablet for tablet 92191057dfa04eb3a8a0683ebd3b65e7 (DEFAULT_TABLE table=test-table [id=6f100d57e5394b3089e1d3ccfe672c08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:11.023524 22639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92191057dfa04eb3a8a0683ebd3b65e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:11.024377 23071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92191057dfa04eb3a8a0683ebd3b65e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:11.035982 23210 tablet_bootstrap.cc:492] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Bootstrap starting.
I20260809 22:55:11.039122 23213 tablet_bootstrap.cc:492] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Bootstrap starting.
I20260809 22:55:11.040938 23214 tablet_bootstrap.cc:492] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Bootstrap starting.
I20260809 22:55:11.041918 23210 tablet_bootstrap.cc:654] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:11.043094 23213 tablet_bootstrap.cc:654] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:11.043358 23210 log.cc:824] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:11.043957 23214 tablet_bootstrap.cc:654] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:11.044435 23213 log.cc:824] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:11.045342 23214 log.cc:824] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:11.047737 23210 tablet_bootstrap.cc:492] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: No bootstrap required, opened a new log
I20260809 22:55:11.048051 23210 ts_tablet_manager.cc:1397] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260809 22:55:11.048449 23213 tablet_bootstrap.cc:492] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: No bootstrap required, opened a new log
I20260809 22:55:11.048861 23213 ts_tablet_manager.cc:1397] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260809 22:55:11.055449 23214 tablet_bootstrap.cc:492] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: No bootstrap required, opened a new log
I20260809 22:55:11.055780 23214 ts_tablet_manager.cc:1397] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.008s
I20260809 22:55:11.056773 23210 raft_consensus.cc:348] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.057772 23210 raft_consensus.cc:374] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:11.057951 23210 raft_consensus.cc:729] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cdbd89ebbf949cda033368b6b9bd705, State: Initialized, Role: FOLLOWER
I20260809 22:55:11.058590 23210 consensus_queue.cc:260] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.059787 22948 heartbeater.cc:503] Master 127.23.131.126:45207 was elected leader, sending a full tablet report...
I20260809 22:55:11.060601 23213 raft_consensus.cc:348] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.061146 23213 raft_consensus.cc:374] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:11.061287 23213 raft_consensus.cc:729] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371ff233cc3847afa1c2209c4aec8fe3, State: Initialized, Role: FOLLOWER
I20260809 22:55:11.061942 23213 consensus_queue.cc:260] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.063848 23213 ts_tablet_manager.cc:1428] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260809 22:55:11.065037 23210 ts_tablet_manager.cc:1428] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Time spent starting tablet: real 0.017s user 0.006s sys 0.006s
I20260809 22:55:11.066671 23214 raft_consensus.cc:348] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.067188 23214 raft_consensus.cc:374] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:11.067404 23214 raft_consensus.cc:729] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd81ddd383e34331908708804bf6dcda, State: Initialized, Role: FOLLOWER
I20260809 22:55:11.068198 23214 consensus_queue.cc:260] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.069505 23183 heartbeater.cc:503] Master 127.23.131.126:45207 was elected leader, sending a full tablet report...
I20260809 22:55:11.070214 23214 ts_tablet_manager.cc:1428] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
W20260809 22:55:11.098466 22949 tablet.cc:2369] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:11.163282 23220 raft_consensus.cc:482] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 22:55:11.163586 23220 raft_consensus.cc:504] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.165303 23220 leader_election.cc:288] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371ff233cc3847afa1c2209c4aec8fe3 (127.23.131.65:39611), cd81ddd383e34331908708804bf6dcda (127.23.131.67:43267)
W20260809 22:55:11.167297 23184 tablet.cc:2369] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:11.174495 23207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.165813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:49477 (local address 127.23.131.65:39611)
0809 22:55:11.166041 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.166047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.166956 (+ 909us) server_negotiation.cc:407] Connection header received
0809 22:55:11.167298 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.167303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.167397 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.167487 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:11.168391 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.169391 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.172126 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.173398 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.173573 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.173652 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.174107 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.174241 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:55:11.174492 23209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.165895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:59315 (local address 127.23.131.67:43267)
0809 22:55:11.166132 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.166139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.166891 (+ 752us) server_negotiation.cc:407] Connection header received
0809 22:55:11.167117 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.167122 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.167210 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.167372 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:11.168005 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.169149 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.172126 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.173402 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.173580 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.173652 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.174107 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.174240 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:55:11.174758 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.165832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:43267 (local address 127.23.131.66:59315)
0809 22:55:11.166744 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:11.166771 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:11.166939 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:11.167404 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:11.167409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:11.167438 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:11.167841 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.167856 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.169277 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.169280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.171936 (+ 2656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.171953 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.173711 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.173718 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.173894 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.173980 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 22:55:11.174063 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 22:55:11.174233 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":171,"thread_start_us":440,"threads_started":1}
I20260809 22:55:11.174784 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.165893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:39611 (local address 127.23.131.66:49477)
0809 22:55:11.166866 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:11.166881 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:11.167059 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:11.167692 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:11.167697 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:11.167731 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:11.168199 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.168213 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.169519 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.169524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.171936 (+ 2412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:11.171953 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.173698 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.173704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:11.173912 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.173962 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 22:55:11.174064 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 22:55:11.174233 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":153,"thread_start_us":430,"threads_started":1}
I20260809 22:55:11.175910 23111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92191057dfa04eb3a8a0683ebd3b65e7" candidate_uuid: "4cdbd89ebbf949cda033368b6b9bd705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd81ddd383e34331908708804bf6dcda" is_pre_election: true
I20260809 22:55:11.175909 22670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92191057dfa04eb3a8a0683ebd3b65e7" candidate_uuid: "4cdbd89ebbf949cda033368b6b9bd705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371ff233cc3847afa1c2209c4aec8fe3" is_pre_election: true
I20260809 22:55:11.176445 23111 raft_consensus.cc:2454] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cdbd89ebbf949cda033368b6b9bd705 in term 0.
I20260809 22:55:11.176445 22670 raft_consensus.cc:2454] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cdbd89ebbf949cda033368b6b9bd705 in term 0.
I20260809 22:55:11.177136 22766 leader_election.cc:302] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cdbd89ebbf949cda033368b6b9bd705, cd81ddd383e34331908708804bf6dcda; no voters:
I20260809 22:55:11.177618 23220 raft_consensus.cc:2781] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:55:11.177768 23220 raft_consensus.cc:482] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:55:11.177898 23220 raft_consensus.cc:3037] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:11.180330 23220 raft_consensus.cc:504] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.181059 23220 leader_election.cc:288] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [CANDIDATE]: Term 1 election: Requested vote from peers 371ff233cc3847afa1c2209c4aec8fe3 (127.23.131.65:39611), cd81ddd383e34331908708804bf6dcda (127.23.131.67:43267)
I20260809 22:55:11.181528 22670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92191057dfa04eb3a8a0683ebd3b65e7" candidate_uuid: "4cdbd89ebbf949cda033368b6b9bd705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371ff233cc3847afa1c2209c4aec8fe3"
I20260809 22:55:11.181737 22670 raft_consensus.cc:3037] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:11.181668 23111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92191057dfa04eb3a8a0683ebd3b65e7" candidate_uuid: "4cdbd89ebbf949cda033368b6b9bd705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd81ddd383e34331908708804bf6dcda"
I20260809 22:55:11.181926 23111 raft_consensus.cc:3037] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:11.184357 22670 raft_consensus.cc:2454] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cdbd89ebbf949cda033368b6b9bd705 in term 1.
I20260809 22:55:11.184391 23111 raft_consensus.cc:2454] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cdbd89ebbf949cda033368b6b9bd705 in term 1.
I20260809 22:55:11.184849 22768 leader_election.cc:302] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371ff233cc3847afa1c2209c4aec8fe3, 4cdbd89ebbf949cda033368b6b9bd705; no voters:
I20260809 22:55:11.185209 23220 raft_consensus.cc:2781] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:11.185724 23220 raft_consensus.cc:686] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 1 LEADER]: Becoming Leader. State: Replica: 4cdbd89ebbf949cda033368b6b9bd705, State: Running, Role: LEADER
I20260809 22:55:11.186214 23220 consensus_queue.cc:237] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } }
I20260809 22:55:11.190845 22447 catalog_manager.cc:5495] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cdbd89ebbf949cda033368b6b9bd705 (127.23.131.66). New cstate: current_term: 1 leader_uuid: "4cdbd89ebbf949cda033368b6b9bd705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cdbd89ebbf949cda033368b6b9bd705" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 } health_report { overall_health: UNKNOWN } } }
I20260809 22:55:11.209795 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.204832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41372 (local address 127.23.131.66:46313)
0809 22:55:11.205024 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.205028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.205046 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:55:11.205135 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.205139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.205227 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.205351 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:55:11.205689 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.206385 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.207853 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.208265 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.208358 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.208802 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:55:11.209298 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:55:11.209402 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.209498 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.209591 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 22:55:11.218210 23111 raft_consensus.cc:1261] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 1 FOLLOWER]: Refusing update from remote peer 4cdbd89ebbf949cda033368b6b9bd705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:11.218214 22670 raft_consensus.cc:1261] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 1 FOLLOWER]: Refusing update from remote peer 4cdbd89ebbf949cda033368b6b9bd705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:11.219275 23225 consensus_queue.cc:1035] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd81ddd383e34331908708804bf6dcda" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 43267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:11.219655 23220 consensus_queue.cc:1035] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371ff233cc3847afa1c2209c4aec8fe3" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:11.231834 23230 mvcc.cc:205] Tried to move back new op lower bound from 7316750791539507200 to 7316750791423021056. Current Snapshot: MvccSnapshot[applied={T|T < 7316750791539507200}]
I20260809 22:55:11.246332 22449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:11.246631 22449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:11.250197 22449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 51c0ad59fa814b3f98b59e386e37eb7d: Sending DeleteTablet for 3 replicas of tablet 92191057dfa04eb3a8a0683ebd3b65e7
I20260809 22:55:11.251406 22842 tablet_service.cc:1514] Processing DeleteTablet for tablet 92191057dfa04eb3a8a0683ebd3b65e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:11 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:41368
I20260809 22:55:11.251590 23071 tablet_service.cc:1514] Processing DeleteTablet for tablet 92191057dfa04eb3a8a0683ebd3b65e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:11 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:52824
I20260809 22:55:11.252125 22639 tablet_service.cc:1514] Processing DeleteTablet for tablet 92191057dfa04eb3a8a0683ebd3b65e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:11 UTC) from {username='kudu', principal='kudu/127.23.131.126@KRBTEST.COM'} at 127.0.0.1:42702
I20260809 22:55:11.252724 23246 tablet_replica.cc:330] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: stopping tablet replica
I20260809 22:55:11.253154 23246 raft_consensus.cc:2229] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:55:11.254056 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 22547
I20260809 22:55:11.259864 23252 tablet_replica.cc:330] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: stopping tablet replica
I20260809 22:55:11.260417 23252 raft_consensus.cc:2229] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:11.261031 23252 raft_consensus.cc:2258] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:11.261664 23246 raft_consensus.cc:2258] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:11.263859 23252 ts_tablet_manager.cc:1905] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:11.265288 23246 ts_tablet_manager.cc:1905] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:11.270092 23251 tablet_replica.cc:330] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: stopping tablet replica
I20260809 22:55:11.270562 23251 raft_consensus.cc:2229] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:11.271108 23251 raft_consensus.cc:2258] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:11.272145 23252 ts_tablet_manager.cc:1918] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:11.272382 23252 log.cc:1196] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-0/wal/wals/92191057dfa04eb3a8a0683ebd3b65e7
I20260809 22:55:11.273054 23252 ts_tablet_manager.cc:1939] T 92191057dfa04eb3a8a0683ebd3b65e7 P 371ff233cc3847afa1c2209c4aec8fe3: Deleting consensus metadata
I20260809 22:55:11.275261 22432 catalog_manager.cc:4841] TS 371ff233cc3847afa1c2209c4aec8fe3 (127.23.131.65:39611): tablet 92191057dfa04eb3a8a0683ebd3b65e7 (table test-table [id=6f100d57e5394b3089e1d3ccfe672c08]) successfully deleted
I20260809 22:55:11.278805 23251 ts_tablet_manager.cc:1905] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 22:55:11 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.65@KRBTEST.COM
I20260809 22:55:11.281832 23246 ts_tablet_manager.cc:1918] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:11.282063 23246 log.cc:1196] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/92191057dfa04eb3a8a0683ebd3b65e7
I20260809 22:55:11.282790 23246 ts_tablet_manager.cc:1939] T 92191057dfa04eb3a8a0683ebd3b65e7 P 4cdbd89ebbf949cda033368b6b9bd705: Deleting consensus metadata
I20260809 22:55:11.284862 22428 catalog_manager.cc:4841] TS 4cdbd89ebbf949cda033368b6b9bd705 (127.23.131.66:46313): tablet 92191057dfa04eb3a8a0683ebd3b65e7 (table test-table [id=6f100d57e5394b3089e1d3ccfe672c08]) successfully deleted
I20260809 22:55:11.286824 23251 ts_tablet_manager.cc:1918] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:11.287062 23251 log.cc:1196] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/92191057dfa04eb3a8a0683ebd3b65e7
I20260809 22:55:11.287694 23251 ts_tablet_manager.cc:1939] T 92191057dfa04eb3a8a0683ebd3b65e7 P cd81ddd383e34331908708804bf6dcda: Deleting consensus metadata
I20260809 22:55:11.289690 22430 catalog_manager.cc:4841] TS cd81ddd383e34331908708804bf6dcda (127.23.131.67:43267): tablet 92191057dfa04eb3a8a0683ebd3b65e7 (table test-table [id=6f100d57e5394b3089e1d3ccfe672c08]) successfully deleted
I20260809 22:55:11.289980 23207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.255576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42706 (local address 127.23.131.65:39611)
0809 22:55:11.255808 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.255818 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.271743 (+ 15925us) server_negotiation.cc:407] Connection header received
0809 22:55:11.271949 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.271957 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.272043 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.272170 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:11.274157 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.275283 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.276805 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.277323 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.277463 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.283159 (+ 5696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:11.283178 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:11.283228 (+ 50us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:11.283275 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:11.286778 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:11.287694 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:11.287703 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:11.287705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:11.287904 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:11.288316 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:11.288321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:11.288324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:11.288697 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:11.289025 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.289354 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.289585 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:55:11.290747 22729 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:11.383167 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 22547
I20260809 22:55:11.420671 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 22744
Aug 09 22:55:11 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.66@KRBTEST.COM
I20260809 22:55:11.437825 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.421517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41378 (local address 127.23.131.66:46313)
0809 22:55:11.421704 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.421711 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.421792 (+ 81us) server_negotiation.cc:407] Connection header received
0809 22:55:11.422024 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.422030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.422120 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.422231 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:11.423650 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.424516 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.425928 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.426394 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.426532 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.431159 (+ 4627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:11.431175 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:11.431190 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:11.431290 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:11.434680 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:11.435530 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:11.435537 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:11.435539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:11.435691 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:11.436109 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:11.436113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:11.436115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:11.436508 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:11.436875 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.437174 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.437421 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 22:55:11.438628 22940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:11.559234 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 22744
I20260809 22:55:11.584560 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 22955
Aug 09 22:55:11 dist-test-slave-92m1 krb5kdc[22384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.67@KRBTEST.COM
I20260809 22:55:11.600068 23209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:11.585353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.23.131.67:43267)
0809 22:55:11.585545 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:11.585552 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:11.585665 (+ 113us) server_negotiation.cc:407] Connection header received
0809 22:55:11.585877 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:11.585887 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:11.585966 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:11.586084 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:11.587589 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.588326 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.589605 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:11.589982 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:11.590090 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:11.594589 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:11.594604 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:11.594620 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:11.594653 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:11.597364 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:11.598004 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:11.598011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:11.598014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:11.598170 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:11.598508 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:11.598511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:11.598513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:11.598873 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:11.599113 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:11.599510 (+ 397us) server_negotiation.cc:299] Negotiation successful
0809 22:55:11.599715 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 22:55:11.600705 23174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:11.691174 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 22955
I20260809 22:55:11.716850 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 22401
I20260809 22:55:11.718053 22501 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:11.832815 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 22401
2026-08-09T22:55:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5003 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T22:55:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:11Z Disabled control of system clock
I20260809 22:55:11.952708 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:38093
--webserver_interface=127.23.131.126
--webserver_port=0
--builtin_ntp_servers=127.23.131.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:38093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 22:55:12.320428 23268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:12.320801 23268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:12.321022 23268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:12.329124 23268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:12.329315 23268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:12.329393 23268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:12.329517 23268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:12.329612 23268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:12.340088 23268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:38093
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:38093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:12.341632 23268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:12.343653 23268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:12.356385 23278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:12.356622 23279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:12.356647 23281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:12.357920 23268 server_base.cc:1034] running on GCE node
I20260809 22:55:12.358847 23268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:12.360481 23268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:12.361719 23268 hybrid_clock.cc:648] HybridClock initialized: now 1786316112361669 us; error 45 us; skew 500 ppm
I20260809 22:55:12.362124 23268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:12.364605 23268 webserver.cc:460] Webserver started at http://127.23.131.126:34875/ using document root <none> and password file <none>
I20260809 22:55:12.365356 23268 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:12.365504 23268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:12.365842 23268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:12.368949 23268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "9e6c65b06863496081caa642602f6028"
format_stamp: "Formatted at 2026-08-09 22:55:12 on dist-test-slave-92m1"
server_key: "6c98100dbb8f2c7bd4e80b672e2ce017"
server_key_iv: "0e5d99c39678fca7a428dfba9b382a67"
server_key_version: "encryptionkey@0"
I20260809 22:55:12.369791 23268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "9e6c65b06863496081caa642602f6028"
format_stamp: "Formatted at 2026-08-09 22:55:12 on dist-test-slave-92m1"
server_key: "6c98100dbb8f2c7bd4e80b672e2ce017"
server_key_iv: "0e5d99c39678fca7a428dfba9b382a67"
server_key_version: "encryptionkey@0"
I20260809 22:55:12.375173 23268 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:55:12.378808 23290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:12.380411 23268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 22:55:12.380613 23268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "9e6c65b06863496081caa642602f6028"
format_stamp: "Formatted at 2026-08-09 22:55:12 on dist-test-slave-92m1"
server_key: "6c98100dbb8f2c7bd4e80b672e2ce017"
server_key_iv: "0e5d99c39678fca7a428dfba9b382a67"
server_key_version: "encryptionkey@0"
I20260809 22:55:12.380841 23268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:12.406888 23268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:12.407863 23268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:12.408206 23268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:12.428608 23268 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:38093
I20260809 22:55:12.428632 23378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:38093 every 8 connection(s)
I20260809 22:55:12.430052 23268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:12.430919 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 23268
I20260809 22:55:12.431124 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:12.431785 24077 external_mini_cluster.cc:1428] Setting key 46b23a2791a50651fec2214d0406ca3d
I20260809 22:55:12.434661 23379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:12.446931 23386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:12.433850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43880 (local address 127.23.131.126:38093)
0809 22:55:12.434937 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:12.434955 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:12.435004 (+ 49us) server_negotiation.cc:407] Connection header received
0809 22:55:12.436901 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:12.436922 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:12.437394 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:12.437723 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:12.438456 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:12.440053 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:12.442018 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:12.442740 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:12.442896 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:12.444265 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:12.444277 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:12.444291 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:12.444957 (+ 666us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:12.445052 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:12.445078 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:12.445199 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:12.445452 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 22:55:12.445895 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":420,"threads_started":1}
I20260809 22:55:12.448031 23379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028: Bootstrap starting.
I20260809 22:55:12.451524 23379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:12.452509 23379 log.cc:824] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:12.455618 23379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028: No bootstrap required, opened a new log
I20260809 22:55:12.463116 23379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e6c65b06863496081caa642602f6028" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38093 } }
I20260809 22:55:12.463574 23379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:12.463686 23379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6c65b06863496081caa642602f6028, State: Initialized, Role: FOLLOWER
I20260809 22:55:12.464358 23379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e6c65b06863496081caa642602f6028" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38093 } }
I20260809 22:55:12.464612 23379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:12.464749 23379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:12.464953 23379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:12.467469 23379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e6c65b06863496081caa642602f6028" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38093 } }
I20260809 22:55:12.467988 23379 leader_election.cc:302] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e6c65b06863496081caa642602f6028; no voters:
I20260809 22:55:12.468614 23379 leader_election.cc:288] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:12.468796 23390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:12.469564 23390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [term 1 LEADER]: Becoming Leader. State: Replica: 9e6c65b06863496081caa642602f6028, State: Running, Role: LEADER
I20260809 22:55:12.470124 23390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e6c65b06863496081caa642602f6028" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38093 } }
I20260809 22:55:12.470768 23379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:12.473132 23391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e6c65b06863496081caa642602f6028" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e6c65b06863496081caa642602f6028" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38093 } } }
I20260809 22:55:12.473017 23392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e6c65b06863496081caa642602f6028. Latest consensus state: current_term: 1 leader_uuid: "9e6c65b06863496081caa642602f6028" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e6c65b06863496081caa642602f6028" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 38093 } } }
I20260809 22:55:12.473604 23391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:12.473688 23392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:12.481235 23405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:12.487444 23405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:12.497079 23405 catalog_manager.cc:1347] Generated new cluster ID: 9eef651583414d32842fc4b184d37afa
I20260809 22:55:12.497223 23405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:12.515839 23405 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:12.517187 23405 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:12.528587 23405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028: Generated new TSK 0
I20260809 22:55:12.529486 23405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:12.539320 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.65:0
--local_ip_for_outbound_sockets=127.23.131.65
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38093
--builtin_ntp_servers=127.23.131.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 22:55:12.923990 23418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:12.924273 23418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:12.924451 23418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:12.931768 23418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:12.931867 23418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:12.932096 23418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.65
I20260809 22:55:12.941313 23418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.131.65
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.65
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:12.942804 23418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:12.945010 23418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:12.958739 23425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:12.958829 23429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:12.958829 23426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:12.959838 23418 server_base.cc:1034] running on GCE node
I20260809 22:55:12.960528 23418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:12.961472 23418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:12.962675 23418 hybrid_clock.cc:648] HybridClock initialized: now 1786316112962629 us; error 34 us; skew 500 ppm
I20260809 22:55:12.962972 23418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:12.965317 23418 webserver.cc:460] Webserver started at http://127.23.131.65:40369/ using document root <none> and password file <none>
I20260809 22:55:12.965971 23418 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:12.966059 23418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:12.966334 23418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:12.969298 23418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data/instance:
uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2"
format_stamp: "Formatted at 2026-08-09 22:55:12 on dist-test-slave-92m1"
server_key: "8548854d21999c82cdd74c5e3cb10e42"
server_key_iv: "2a5d0768cd599879bdade99d69c1b764"
server_key_version: "encryptionkey@0"
I20260809 22:55:12.970077 23418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance:
uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2"
format_stamp: "Formatted at 2026-08-09 22:55:12 on dist-test-slave-92m1"
server_key: "8548854d21999c82cdd74c5e3cb10e42"
server_key_iv: "2a5d0768cd599879bdade99d69c1b764"
server_key_version: "encryptionkey@0"
I20260809 22:55:12.975440 23418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 22:55:12.978994 23439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:12.980463 23418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:12.980690 23418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal
uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2"
format_stamp: "Formatted at 2026-08-09 22:55:12 on dist-test-slave-92m1"
server_key: "8548854d21999c82cdd74c5e3cb10e42"
server_key_iv: "2a5d0768cd599879bdade99d69c1b764"
server_key_version: "encryptionkey@0"
I20260809 22:55:12.980950 23418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:12.995795 23418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:12.996654 23418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:12.996980 23418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:12.997984 23418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:12.999593 23418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:12.999718 23418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:12.999858 23418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:12.999951 23418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:13.034299 23418 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.65:42541
I20260809 22:55:13.034363 23602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.65:42541 every 8 connection(s)
I20260809 22:55:13.035784 23418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/data/info.pb
I20260809 22:55:13.045063 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 23418
I20260809 22:55:13.045251 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-0/wal/instance
I20260809 22:55:13.045791 24077 external_mini_cluster.cc:1428] Setting key af62af670bb3b6a8e7fd6674169b2468
I20260809 22:55:13.049099 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:13.038477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:42303 (local address 127.23.131.126:38093)
0809 22:55:13.038944 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:13.038948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:13.040049 (+ 1101us) server_negotiation.cc:407] Connection header received
0809 22:55:13.041851 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:13.041857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:13.041952 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:13.042086 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:13.043126 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.043923 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.046074 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.046585 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.046711 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:13.048320 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:13.048324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:13.048327 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:13.048350 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:13.048390 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:13.048401 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:13.048474 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:13.048739 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 22:55:13.048817 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":258,"threads_started":1}
I20260809 22:55:13.049067 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.66:0
--local_ip_for_outbound_sockets=127.23.131.66
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38093
--builtin_ntp_servers=127.23.131.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 22:55:13.050534 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:13.038975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38093 (local address 127.23.131.65:42303)
0809 22:55:13.039886 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:13.039928 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:13.041584 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:13.042313 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:13.042321 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:13.042401 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:13.042956 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:13.042972 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.044093 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.044105 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:13.045925 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:13.045941 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.046834 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.046842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:13.047094 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:13.047940 (+ 846us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:55:13.047944 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:13.047998 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:55:13.048118 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:13.048506 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:13.048518 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:13.048526 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 22:55:13.048725 (+ 199us) client_negotiation.cc:240] Negotiation successful
0809 22:55:13.049145 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":310,"threads_started":1}
I20260809 22:55:13.052107 23603 heartbeater.cc:347] Connected to a master server at 127.23.131.126:38093
I20260809 22:55:13.052421 23603 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:13.053207 23603 heartbeater.cc:511] Master 127.23.131.126:38093 requested a full tablet report, sending...
I20260809 22:55:13.055315 23321 ts_manager.cc:194] Registered new tserver with Master: 5ded2fd3d06048c9bd920c5a2dd66ff2 (127.23.131.65:42541)
I20260809 22:55:13.056834 23321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.65:42303
W20260809 22:55:13.404717 23612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:13.405084 23612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:13.405248 23612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:13.412745 23612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:13.412905 23612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:13.413093 23612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.66
I20260809 22:55:13.422788 23612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.131.66
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.66
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:13.424238 23612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:13.426126 23612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:13.441825 23620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:13.441852 23623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:13.442253 23619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:13.442866 23612 server_base.cc:1034] running on GCE node
I20260809 22:55:13.443629 23612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:13.444639 23612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:13.445878 23612 hybrid_clock.cc:648] HybridClock initialized: now 1786316113445828 us; error 39 us; skew 500 ppm
I20260809 22:55:13.446374 23612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:13.448977 23612 webserver.cc:460] Webserver started at http://127.23.131.66:41453/ using document root <none> and password file <none>
I20260809 22:55:13.449695 23612 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:13.449836 23612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:13.450182 23612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:13.453254 23612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data/instance:
uuid: "21fa0150be0c46438a52b6c017af8bd4"
format_stamp: "Formatted at 2026-08-09 22:55:13 on dist-test-slave-92m1"
server_key: "ad090f88b78814f336e0866e36981597"
server_key_iv: "a6f6970ed4bfeffe18e44b0b4f05c409"
server_key_version: "encryptionkey@0"
I20260809 22:55:13.454080 23612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance:
uuid: "21fa0150be0c46438a52b6c017af8bd4"
format_stamp: "Formatted at 2026-08-09 22:55:13 on dist-test-slave-92m1"
server_key: "ad090f88b78814f336e0866e36981597"
server_key_iv: "a6f6970ed4bfeffe18e44b0b4f05c409"
server_key_version: "encryptionkey@0"
I20260809 22:55:13.459586 23612 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:55:13.463352 23633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:13.464716 23612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:55:13.464915 23612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal
uuid: "21fa0150be0c46438a52b6c017af8bd4"
format_stamp: "Formatted at 2026-08-09 22:55:13 on dist-test-slave-92m1"
server_key: "ad090f88b78814f336e0866e36981597"
server_key_iv: "a6f6970ed4bfeffe18e44b0b4f05c409"
server_key_version: "encryptionkey@0"
I20260809 22:55:13.465185 23612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:13.503741 23612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:13.504640 23612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:13.504962 23612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:13.506006 23612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:13.507637 23612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:13.507791 23612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:13.507918 23612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:13.508013 23612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:13.547483 23612 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.66:39751
I20260809 22:55:13.547556 23809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.66:39751 every 8 connection(s)
I20260809 22:55:13.549063 23612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/data/info.pb
I20260809 22:55:13.549464 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 23612
I20260809 22:55:13.549651 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal/instance
I20260809 22:55:13.550309 24077 external_mini_cluster.cc:1428] Setting key 872325a29da23ed91ccaac441cb23fbd
I20260809 22:55:13.553679 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.131.67:0
--local_ip_for_outbound_sockets=127.23.131.67
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38093
--builtin_ntp_servers=127.23.131.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 22:55:13.569240 23813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:13.551812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.66:47185 (local address 127.23.131.126:38093)
0809 22:55:13.552336 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:13.552344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:13.555290 (+ 2946us) server_negotiation.cc:407] Connection header received
0809 22:55:13.555794 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:13.555800 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:13.555892 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:13.556009 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:13.557076 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.557836 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.559502 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.559936 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.560082 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:13.568194 (+ 8112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:13.568200 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:13.568204 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:13.568226 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:13.568271 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:13.568285 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:13.568390 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:13.568657 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 22:55:13.568781 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":269,"threads_started":1}
I20260809 22:55:13.570434 23814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:13.552583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38093 (local address 127.23.131.66:47185)
0809 22:55:13.553701 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:13.553754 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:13.555537 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:13.556251 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:13.556259 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:13.556348 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:13.556904 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:13.556920 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.558007 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.558012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:13.559357 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:13.559370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:13.560191 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:13.560198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:13.560443 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:13.567763 (+ 7320us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:55:13.567767 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:13.567818 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:55:13.567926 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:13.568396 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:13.568412 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:13.568427 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 22:55:13.568627 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 22:55:13.569130 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":360,"threads_started":1}
I20260809 22:55:13.572103 23810 heartbeater.cc:347] Connected to a master server at 127.23.131.126:38093
I20260809 22:55:13.572486 23810 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:13.573276 23810 heartbeater.cc:511] Master 127.23.131.126:38093 requested a full tablet report, sending...
I20260809 22:55:13.574745 23321 ts_manager.cc:194] Registered new tserver with Master: 21fa0150be0c46438a52b6c017af8bd4 (127.23.131.66:39751)
I20260809 22:55:13.576061 23321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.66:47185
W20260809 22:55:13.914076 23815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:13.914350 23815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:13.914439 23815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:13.921669 23815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:13.921777 23815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:13.921885 23815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.131.67
I20260809 22:55:13.930996 23815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.131.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.131.67
--webserver_port=0
--tserver_master_addrs=127.23.131.126:38093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.131.67
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:13.932338 23815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:13.934093 23815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:13.947904 23825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:13.948016 23828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:13.948925 23824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:13.949262 23815 server_base.cc:1034] running on GCE node
I20260809 22:55:13.949914 23815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:13.950955 23815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:13.952200 23815 hybrid_clock.cc:648] HybridClock initialized: now 1786316113952139 us; error 55 us; skew 500 ppm
I20260809 22:55:13.952535 23815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 22:55:13.955174 23815 webserver.cc:460] Webserver started at http://127.23.131.67:39185/ using document root <none> and password file <none>
I20260809 22:55:13.955957 23815 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:13.956100 23815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:13.956441 23815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:13.959618 23815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data/instance:
uuid: "a8cbc4274a16451f8fd8c844e3d378fe"
format_stamp: "Formatted at 2026-08-09 22:55:13 on dist-test-slave-92m1"
server_key: "7729cacd92023686907a1e6d01cc991f"
server_key_iv: "21b82ea2367e1dee84eed93e17a67cef"
server_key_version: "encryptionkey@0"
I20260809 22:55:13.960456 23815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance:
uuid: "a8cbc4274a16451f8fd8c844e3d378fe"
format_stamp: "Formatted at 2026-08-09 22:55:13 on dist-test-slave-92m1"
server_key: "7729cacd92023686907a1e6d01cc991f"
server_key_iv: "21b82ea2367e1dee84eed93e17a67cef"
server_key_version: "encryptionkey@0"
I20260809 22:55:13.968209 23815 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260809 22:55:13.973999 23838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:13.975865 23815 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 22:55:13.976089 23815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal
uuid: "a8cbc4274a16451f8fd8c844e3d378fe"
format_stamp: "Formatted at 2026-08-09 22:55:13 on dist-test-slave-92m1"
server_key: "7729cacd92023686907a1e6d01cc991f"
server_key_iv: "21b82ea2367e1dee84eed93e17a67cef"
server_key_version: "encryptionkey@0"
I20260809 22:55:13.976358 23815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:13.999791 23815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:14.000726 23815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:14.001087 23815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:14.002184 23815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 22:55:14.003888 23815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 22:55:14.004015 23815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:14.004176 23815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 22:55:14.004266 23815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:14.038897 23815 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.67:34189
I20260809 22:55:14.038950 24000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.67:34189 every 8 connection(s)
I20260809 22:55:14.040553 23815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/data/info.pb
I20260809 22:55:14.046566 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 23815
I20260809 22:55:14.046764 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal/instance
I20260809 22:55:14.047298 24077 external_mini_cluster.cc:1428] Setting key 5d03e0e7b8281cacba5034472be6b335
I20260809 22:55:14.053587 23813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.043237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.67:54095 (local address 127.23.131.126:38093)
0809 22:55:14.043433 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.043438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.044809 (+ 1371us) server_negotiation.cc:407] Connection header received
0809 22:55:14.046592 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.046600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.046698 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.046817 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:14.048060 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.049109 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.050910 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.051373 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.051472 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.052832 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:14.052836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:14.052839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:14.052856 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:14.052884 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:14.052895 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:14.052961 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.053219 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.053322 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 22:55:14.054534 24006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.043722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:38093 (local address 127.23.131.67:54095)
0809 22:55:14.044653 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.044692 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:14.046313 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:14.047054 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:14.047062 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:14.047143 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:55:14.047848 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.047866 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.049262 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.049269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.050779 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.050791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.051574 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.051579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.051785 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.052524 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 22:55:14.052527 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:55:14.052567 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 22:55:14.052663 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:55:14.052980 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:55:14.052989 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:55:14.052995 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 22:55:14.053139 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 22:55:14.053436 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":295,"threads_started":1}
I20260809 22:55:14.056275 24003 heartbeater.cc:347] Connected to a master server at 127.23.131.126:38093
I20260809 22:55:14.056569 24003 heartbeater.cc:464] Registering TS with master...
I20260809 22:55:14.057288 24003 heartbeater.cc:511] Master 127.23.131.126:38093 requested a full tablet report, sending...
I20260809 22:55:14.058678 23321 ts_manager.cc:194] Registered new tserver with Master: a8cbc4274a16451f8fd8c844e3d378fe (127.23.131.67:34189)
I20260809 22:55:14.059690 23321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.131.67:54095
I20260809 22:55:14.059767 23603 heartbeater.cc:503] Master 127.23.131.126:38093 was elected leader, sending a full tablet report...
I20260809 22:55:14.062870 24077 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 22:55:14.073792 23813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.067190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43888 (local address 127.23.131.126:38093)
0809 22:55:14.067398 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.067403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.067915 (+ 512us) server_negotiation.cc:407] Connection header received
0809 22:55:14.068123 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.068128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.068203 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.068307 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:14.068914 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.069665 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.071062 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.071595 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.071735 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.072992 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:14.072998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:14.073003 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:14.073029 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:14.073076 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:14.073089 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:14.073190 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.073341 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.073443 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 22:55:14.078151 23320 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 22:55:14.085963 23320 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 22:55:14.123294 24024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.098275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:34189 (local address 127.0.0.1:47606)
0809 22:55:14.107833 (+ 9558us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.107874 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:14.108068 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:14.114939 (+ 6871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:14.114951 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:14.114991 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:14.115518 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.115539 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.117835 (+ 2296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.117851 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.120423 (+ 2572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.120443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.122312 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.122318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.122537 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.122588 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 22:55:14.122729 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 22:55:14.122918 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9275,"thread_start_us":17681,"threads_started":1}
I20260809 22:55:14.124240 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.098648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47606 (local address 127.23.131.67:34189)
0809 22:55:14.113735 (+ 15087us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.113744 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.113779 (+ 35us) server_negotiation.cc:407] Connection header received
0809 22:55:14.113902 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.113912 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.114234 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.114491 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:14.116084 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.117693 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.120632 (+ 2939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.122096 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.122271 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.122582 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.122810 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.123834 (+ 1024us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14910,"thread_start_us":14747,"threads_started":1}
I20260809 22:55:14.124379 24031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.113764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:39751 (local address 127.0.0.1:58830)
0809 22:55:14.116691 (+ 2927us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.116706 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:14.116833 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:14.117386 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:14.117390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:14.117414 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:14.117942 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.117961 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.119950 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.119956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.121719 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.121735 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.123613 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.123620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.123790 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.123820 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 22:55:14.123910 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 22:55:14.124043 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2817,"mutex_wait_us":76,"thread_start_us":2082,"threads_started":1}
I20260809 22:55:14.125172 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.108566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.23.131.66:39751)
0809 22:55:14.115545 (+ 6979us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.115553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.116809 (+ 1256us) server_negotiation.cc:407] Connection header received
0809 22:55:14.117000 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.117007 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.117208 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.117382 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:14.118167 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.119766 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.121917 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.123296 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.123456 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.123691 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.124643 (+ 952us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.124813 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6812,"thread_start_us":6696,"threads_started":1}
I20260809 22:55:14.125610 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.098563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:39386)
0809 22:55:14.116241 (+ 17678us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.116260 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:14.116401 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:14.117329 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:14.117337 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:14.117367 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:14.117971 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.117982 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.119689 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.119693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.122145 (+ 2452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.122163 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.124839 (+ 2676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.124844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.124970 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.124992 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 22:55:14.125111 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 22:55:14.125233 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17557,"mutex_wait_us":140,"thread_start_us":8837,"threads_started":1}
I20260809 22:55:14.126041 24025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.098767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39386 (local address 127.23.131.65:42541)
0809 22:55:14.113328 (+ 14561us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.113341 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.116403 (+ 3062us) server_negotiation.cc:407] Connection header received
0809 22:55:14.116623 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.116630 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.116892 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.117075 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:14.118202 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.119519 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.122368 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.124222 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.124362 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.124709 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.125159 (+ 450us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.125477 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14320,"thread_start_us":14141,"threads_started":1}
I20260809 22:55:14.128460 23906 tablet_service.cc:1467] Processing CreateTablet for tablet 848bbb3c44ce4e709a0dfbaaf9c36415 (DEFAULT_TABLE table=test-table [id=d47d8e1c013e47ab9ef6b8f42691c7c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:14.128782 23701 tablet_service.cc:1467] Processing CreateTablet for tablet 848bbb3c44ce4e709a0dfbaaf9c36415 (DEFAULT_TABLE table=test-table [id=d47d8e1c013e47ab9ef6b8f42691c7c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:14.129917 23701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848bbb3c44ce4e709a0dfbaaf9c36415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:14.129433 23512 tablet_service.cc:1467] Processing CreateTablet for tablet 848bbb3c44ce4e709a0dfbaaf9c36415 (DEFAULT_TABLE table=test-table [id=d47d8e1c013e47ab9ef6b8f42691c7c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 22:55:14.130034 23906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848bbb3c44ce4e709a0dfbaaf9c36415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:14.130748 23512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848bbb3c44ce4e709a0dfbaaf9c36415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:14.142796 24032 tablet_bootstrap.cc:492] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Bootstrap starting.
I20260809 22:55:14.145254 24034 tablet_bootstrap.cc:492] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Bootstrap starting.
I20260809 22:55:14.147588 24033 tablet_bootstrap.cc:492] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: Bootstrap starting.
I20260809 22:55:14.148335 24032 tablet_bootstrap.cc:654] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:14.149096 24034 tablet_bootstrap.cc:654] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:14.149494 24032 log.cc:824] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:14.150420 24034 log.cc:824] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:14.151885 24033 tablet_bootstrap.cc:654] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:14.152920 24032 tablet_bootstrap.cc:492] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: No bootstrap required, opened a new log
I20260809 22:55:14.153220 24032 ts_tablet_manager.cc:1397] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260809 22:55:14.153239 24033 log.cc:824] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:14.154562 24034 tablet_bootstrap.cc:492] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: No bootstrap required, opened a new log
I20260809 22:55:14.154882 24034 ts_tablet_manager.cc:1397] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260809 22:55:14.157470 24033 tablet_bootstrap.cc:492] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: No bootstrap required, opened a new log
I20260809 22:55:14.157753 24033 ts_tablet_manager.cc:1397] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 22:55:14.161549 24032 raft_consensus.cc:348] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.161990 24032 raft_consensus.cc:374] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:14.162123 24032 raft_consensus.cc:729] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fa0150be0c46438a52b6c017af8bd4, State: Initialized, Role: FOLLOWER
I20260809 22:55:14.162814 24032 consensus_queue.cc:260] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.164572 23810 heartbeater.cc:503] Master 127.23.131.126:38093 was elected leader, sending a full tablet report...
I20260809 22:55:14.165366 24032 ts_tablet_manager.cc:1428] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260809 22:55:14.166164 24034 raft_consensus.cc:348] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.166631 24034 raft_consensus.cc:374] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:14.166723 24034 raft_consensus.cc:729] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8cbc4274a16451f8fd8c844e3d378fe, State: Initialized, Role: FOLLOWER
I20260809 22:55:14.167506 24034 consensus_queue.cc:260] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.168709 24003 heartbeater.cc:503] Master 127.23.131.126:38093 was elected leader, sending a full tablet report...
I20260809 22:55:14.169169 24033 raft_consensus.cc:348] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.169656 24033 raft_consensus.cc:374] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:14.169762 24033 raft_consensus.cc:729] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ded2fd3d06048c9bd920c5a2dd66ff2, State: Initialized, Role: FOLLOWER
I20260809 22:55:14.170460 24033 consensus_queue.cc:260] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.171010 24034 ts_tablet_manager.cc:1428] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
I20260809 22:55:14.172494 24033 ts_tablet_manager.cc:1428] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
W20260809 22:55:14.288275 23604 tablet.cc:2369] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:14.292045 24042 raft_consensus.cc:482] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260809 22:55:14.292361 24004 tablet.cc:2369] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:14.292425 24042 raft_consensus.cc:504] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.294247 24042 leader_election.cc:288] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8cbc4274a16451f8fd8c844e3d378fe (127.23.131.67:34189), 21fa0150be0c46438a52b6c017af8bd4 (127.23.131.66:39751)
W20260809 22:55:14.301481 23812 tablet.cc:2369] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:55:14.301580 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.294807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:37199 (local address 127.23.131.66:39751)
0809 22:55:14.295063 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.295069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.295683 (+ 614us) server_negotiation.cc:407] Connection header received
0809 22:55:14.295875 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.295881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.295976 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.296074 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:14.296744 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.297544 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.299730 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.300502 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.300649 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.300702 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.301126 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.301276 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:55:14.301652 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.294542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.66:39751 (local address 127.23.131.65:37199)
0809 22:55:14.295522 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.295548 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:14.295720 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:14.296113 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:14.296117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:14.296144 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:14.296553 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.296564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.297690 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.297696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.299520 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.299533 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.300717 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.300727 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.300935 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.300973 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 22:55:14.301050 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 22:55:14.301208 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":71,"thread_start_us":479,"threads_started":1}
I20260809 22:55:14.301949 24044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.294671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.67:34189 (local address 127.23.131.65:38857)
0809 22:55:14.295706 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.295724 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:55:14.295889 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:55:14.296382 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:55:14.296385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:55:14.296411 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 22:55:14.296850 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.296863 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.297950 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.297954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.299561 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:55:14.299577 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.300863 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.300868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:55:14.300998 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.301051 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 22:55:14.301148 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 22:55:14.301273 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"mutex_wait_us":52,"thread_start_us":686,"threads_started":1}
I20260809 22:55:14.302059 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.294631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.131.65:38857 (local address 127.23.131.67:34189)
0809 22:55:14.294840 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.294847 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.295858 (+ 1011us) server_negotiation.cc:407] Connection header received
0809 22:55:14.296111 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.296117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.296200 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.296309 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 22:55:14.297021 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.297803 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.299788 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.300643 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.300819 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.300892 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.301645 (+ 753us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.301798 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:55:14.302868 23730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bbb3c44ce4e709a0dfbaaf9c36415" candidate_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fa0150be0c46438a52b6c017af8bd4" is_pre_election: true
I20260809 22:55:14.302910 23935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bbb3c44ce4e709a0dfbaaf9c36415" candidate_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" is_pre_election: true
I20260809 22:55:14.303562 23935 raft_consensus.cc:2454] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ded2fd3d06048c9bd920c5a2dd66ff2 in term 0.
I20260809 22:55:14.303560 23730 raft_consensus.cc:2454] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ded2fd3d06048c9bd920c5a2dd66ff2 in term 0.
I20260809 22:55:14.304344 23444 leader_election.cc:302] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ded2fd3d06048c9bd920c5a2dd66ff2, a8cbc4274a16451f8fd8c844e3d378fe; no voters:
I20260809 22:55:14.304800 24042 raft_consensus.cc:2781] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 22:55:14.304963 24042 raft_consensus.cc:482] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 22:55:14.305095 24042 raft_consensus.cc:3037] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:14.307422 24042 raft_consensus.cc:504] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.308187 24042 leader_election.cc:288] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [CANDIDATE]: Term 1 election: Requested vote from peers a8cbc4274a16451f8fd8c844e3d378fe (127.23.131.67:34189), 21fa0150be0c46438a52b6c017af8bd4 (127.23.131.66:39751)
I20260809 22:55:14.308678 23935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bbb3c44ce4e709a0dfbaaf9c36415" candidate_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8cbc4274a16451f8fd8c844e3d378fe"
I20260809 22:55:14.308787 23730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bbb3c44ce4e709a0dfbaaf9c36415" candidate_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fa0150be0c46438a52b6c017af8bd4"
I20260809 22:55:14.308929 23935 raft_consensus.cc:3037] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:14.309000 23730 raft_consensus.cc:3037] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:14.312420 23935 raft_consensus.cc:2454] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ded2fd3d06048c9bd920c5a2dd66ff2 in term 1.
I20260809 22:55:14.312420 23730 raft_consensus.cc:2454] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ded2fd3d06048c9bd920c5a2dd66ff2 in term 1.
I20260809 22:55:14.312932 23444 leader_election.cc:302] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ded2fd3d06048c9bd920c5a2dd66ff2, a8cbc4274a16451f8fd8c844e3d378fe; no voters:
I20260809 22:55:14.313313 24042 raft_consensus.cc:2781] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:14.313786 24042 raft_consensus.cc:686] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 1 LEADER]: Becoming Leader. State: Replica: 5ded2fd3d06048c9bd920c5a2dd66ff2, State: Running, Role: LEADER
I20260809 22:55:14.314298 24042 consensus_queue.cc:237] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } }
I20260809 22:55:14.319628 23321 catalog_manager.cc:5495] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ded2fd3d06048c9bd920c5a2dd66ff2 (127.23.131.65). New cstate: current_term: 1 leader_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ded2fd3d06048c9bd920c5a2dd66ff2" member_type: VOTER last_known_addr { host: "127.23.131.65" port: 42541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260809 22:55:14.367132 24025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.361698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51662 (local address 127.23.131.65:42541)
0809 22:55:14.361918 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.361922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.361938 (+ 16us) server_negotiation.cc:407] Connection header received
0809 22:55:14.362026 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.362030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.362134 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.362294 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:55:14.362679 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.363428 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.364882 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.365324 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.365480 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.365984 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:55:14.366504 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:55:14.366670 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.366785 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.366870 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:55:14.376214 23730 raft_consensus.cc:1261] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 1 FOLLOWER]: Refusing update from remote peer 5ded2fd3d06048c9bd920c5a2dd66ff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:14.376214 23935 raft_consensus.cc:1261] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 1 FOLLOWER]: Refusing update from remote peer 5ded2fd3d06048c9bd920c5a2dd66ff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:55:14.377543 24045 consensus_queue.cc:1035] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8cbc4274a16451f8fd8c844e3d378fe" member_type: VOTER last_known_addr { host: "127.23.131.67" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:14.377980 24042 consensus_queue.cc:1035] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fa0150be0c46438a52b6c017af8bd4" member_type: VOTER last_known_addr { host: "127.23.131.66" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:55:14.396549 24053 mvcc.cc:205] Tried to move back new op lower bound from 7316750804473262080 to 7316750804235403264. Current Snapshot: MvccSnapshot[applied={T|T < 7316750804473262080}]
I20260809 22:55:14.405023 23320 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:14.405346 23320 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 22:55:14.409104 23320 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e6c65b06863496081caa642602f6028: Sending DeleteTablet for 3 replicas of tablet 848bbb3c44ce4e709a0dfbaaf9c36415
I20260809 22:55:14.410475 23906 tablet_service.cc:1514] Processing DeleteTablet for tablet 848bbb3c44ce4e709a0dfbaaf9c36415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:14 UTC) from {username='slave'} at 127.0.0.1:47606
I20260809 22:55:14.410517 23701 tablet_service.cc:1514] Processing DeleteTablet for tablet 848bbb3c44ce4e709a0dfbaaf9c36415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:14 UTC) from {username='slave'} at 127.0.0.1:58830
I20260809 22:55:14.410513 23512 tablet_service.cc:1514] Processing DeleteTablet for tablet 848bbb3c44ce4e709a0dfbaaf9c36415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 22:55:14 UTC) from {username='slave'} at 127.0.0.1:39386
I20260809 22:55:14.412902 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 23418
I20260809 22:55:14.422688 24075 tablet_replica.cc:330] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: stopping tablet replica
I20260809 22:55:14.424347 24075 raft_consensus.cc:2229] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:14.426090 24075 raft_consensus.cc:2258] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:14.430070 24075 ts_tablet_manager.cc:1905] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:14.431862 24025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.414580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51678 (local address 127.23.131.65:42541)
0809 22:55:14.414817 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.414825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.419473 (+ 4648us) server_negotiation.cc:407] Connection header received
0809 22:55:14.419704 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.419711 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.419827 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.419964 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:14.423008 (+ 3044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.424333 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.427065 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.427830 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.427967 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.429770 (+ 1803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:14.429783 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:14.429800 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:14.430682 (+ 882us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:14.430756 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:14.430786 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:14.430889 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.431188 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.431354 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 22:55:14.432938 24074 tablet_replica.cc:330] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2: stopping tablet replica
I20260809 22:55:14.433907 24073 tablet_replica.cc:330] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: stopping tablet replica
I20260809 22:55:14.434383 24073 raft_consensus.cc:2229] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 22:55:14.434918 24073 raft_consensus.cc:2258] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 22:55:14.433394 23597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:14.442802 24075 ts_tablet_manager.cc:1918] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:14.443045 24075 log.cc:1196] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-2/wal/wals/848bbb3c44ce4e709a0dfbaaf9c36415
I20260809 22:55:14.443638 24075 ts_tablet_manager.cc:1939] T 848bbb3c44ce4e709a0dfbaaf9c36415 P a8cbc4274a16451f8fd8c844e3d378fe: Deleting consensus metadata
I20260809 22:55:14.444818 24073 ts_tablet_manager.cc:1905] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 22:55:14.445756 23296 catalog_manager.cc:4841] TS a8cbc4274a16451f8fd8c844e3d378fe (127.23.131.67:34189): tablet 848bbb3c44ce4e709a0dfbaaf9c36415 (table test-table [id=d47d8e1c013e47ab9ef6b8f42691c7c3]) successfully deleted
I20260809 22:55:14.452101 24073 ts_tablet_manager.cc:1918] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 22:55:14.452338 24073 log.cc:1196] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Deleting WAL directory at /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786315774646092-24077-0/minicluster-data/ts-1/wal/wals/848bbb3c44ce4e709a0dfbaaf9c36415
I20260809 22:55:14.452915 24073 ts_tablet_manager.cc:1939] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 21fa0150be0c46438a52b6c017af8bd4: Deleting consensus metadata
I20260809 22:55:14.454761 23297 catalog_manager.cc:4841] TS 21fa0150be0c46438a52b6c017af8bd4 (127.23.131.66:39751): tablet 848bbb3c44ce4e709a0dfbaaf9c36415 (table test-table [id=d47d8e1c013e47ab9ef6b8f42691c7c3]) successfully deleted
I20260809 22:55:14.442281 24074 raft_consensus.cc:2229] T 848bbb3c44ce4e709a0dfbaaf9c36415 P 5ded2fd3d06048c9bd920c5a2dd66ff2 [term 1 LEADER]: Raft consensus shutting down.
I20260809 22:55:14.548897 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 23418
W20260809 22:55:14.572556 23297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.131.65:42541 (error 108)
I20260809 22:55:14.573472 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 23612
I20260809 22:55:14.574836 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.574300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51694)
0809 22:55:14.574519 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.574667 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 22:55:14.575100 23297 catalog_manager.cc:4584] TS 5ded2fd3d06048c9bd920c5a2dd66ff2 (127.23.131.65:42541): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 848bbb3c44ce4e709a0dfbaaf9c36415: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
I20260809 22:55:14.581095 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.574597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.23.131.66:39751)
0809 22:55:14.574812 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.574818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.574838 (+ 20us) server_negotiation.cc:407] Connection header received
0809 22:55:14.574931 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.574938 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.575061 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.575189 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:14.575657 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.576430 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.577740 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.578175 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.578318 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.579639 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:14.579649 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:14.579663 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:14.580313 (+ 650us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:14.580369 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:14.580389 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:14.580554 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.580636 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.580753 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 22:55:14.581861 23805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:14.628932 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.628375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51700)
0809 22:55:14.628631 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.628746 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 22:55:14.630115 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.629693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51710)
0809 22:55:14.629865 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.629954 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 22:55:14.674029 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 23612
I20260809 22:55:14.690907 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.690277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51714)
0809 22:55:14.690545 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.690667 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 22:55:14.692162 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.691677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51720)
0809 22:55:14.691877 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.691980 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 22:55:14.700255 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 23815
I20260809 22:55:14.707626 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.701100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41814 (local address 127.23.131.67:34189)
0809 22:55:14.701316 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:14.701324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:14.701367 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:55:14.701603 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:14.701609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:14.701712 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:14.701825 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:14.702283 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.703053 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.704377 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:14.704808 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:14.704947 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:14.706009 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:14.706036 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:14.706052 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:14.706667 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:14.706719 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:14.706738 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:14.706879 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:14.707012 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 22:55:14.707154 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 22:55:14.708375 23994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:14.773414 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.772910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51726)
0809 22:55:14.773127 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.773228 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 22:55:14.774500 24023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:14.774103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.65:42541 (local address 127.0.0.1:51738)
0809 22:55:14.774314 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 22:55:14.774388 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 22:55:14.799947 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 23815
I20260809 22:55:14.830111 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 23268
I20260809 22:55:14.831512 23372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:14.945137 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 23268
2026-08-09T22:55:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3112 ms)
[----------] 6 tests from EncryptionPolicyTest (24321 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:15 dist-test-slave-92m1 krb5kdc[24095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:15 dist-test-slave-92m1 krb5kdc[24095](info): set up 2 sockets
Aug 09 22:55:15 dist-test-slave-92m1 krb5kdc[24095](info): commencing operation
krb5kdc: starting...
W20260809 22:55:16.343493 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.005s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:16 dist-test-slave-92m1 krb5kdc[24095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:16.743747 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37207
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:17.125051 24111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:17.125377 24111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:17.125557 24111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:17.133265 24111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:17.133396 24111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:17.133493 24111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:17.133613 24111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:17.133695 24111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:17.144191 24111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37207
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:17.145648 24111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:17.147053 24111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:17.160148 24120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:17.160034 24123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:17.160096 24121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:17.161702 24111 server_base.cc:1034] running on GCE node
I20260809 22:55:17.162609 24111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:17.164232 24111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:17.165477 24111 hybrid_clock.cc:648] HybridClock initialized: now 1786316117165430 us; error 42 us; skew 500 ppm
I20260809 22:55:17.165845 24111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:17 dist-test-slave-92m1 krb5kdc[24095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316117, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:17.169341 24111 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:17.170913 24111 webserver.cc:460] Webserver started at http://127.0.0.1:42357/ using document root <none> and password file <none>
I20260809 22:55:17.171694 24111 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:17.171851 24111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:17.172186 24111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:17.175410 24111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c9e7edec69e646f9a7a1616c96f965f8"
format_stamp: "Formatted at 2026-08-09 22:55:17 on dist-test-slave-92m1"
server_key: "22ccf46397e373aef4ff1fc30247b231"
server_key_iv: "a98857e261fe5befa1e7ca8aeb949a81"
server_key_version: "encryptionkey@0"
I20260809 22:55:17.176227 24111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c9e7edec69e646f9a7a1616c96f965f8"
format_stamp: "Formatted at 2026-08-09 22:55:17 on dist-test-slave-92m1"
server_key: "22ccf46397e373aef4ff1fc30247b231"
server_key_iv: "a98857e261fe5befa1e7ca8aeb949a81"
server_key_version: "encryptionkey@0"
I20260809 22:55:17.181697 24111 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:17.185407 24138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:17.186882 24111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:17.187103 24111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c9e7edec69e646f9a7a1616c96f965f8"
format_stamp: "Formatted at 2026-08-09 22:55:17 on dist-test-slave-92m1"
server_key: "22ccf46397e373aef4ff1fc30247b231"
server_key_iv: "a98857e261fe5befa1e7ca8aeb949a81"
server_key_version: "encryptionkey@0"
I20260809 22:55:17.187400 24111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:17.203055 24111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:17.207862 24111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:17.208212 24111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:17.229202 24111 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37207
I20260809 22:55:17.229242 24215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37207 every 8 connection(s)
I20260809 22:55:17.230716 24111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:17.234912 24216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:17.239507 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24111
I20260809 22:55:17.239751 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:17.240666 24077 external_mini_cluster.cc:1428] Setting key 08e6de49bdc95984ded535e9286d981b
I20260809 22:55:17.247301 24216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8: Bootstrap starting.
I20260809 22:55:17.250659 24216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:17.251845 24216 log.cc:824] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:17.254830 24216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8: No bootstrap required, opened a new log
Aug 09 22:55:17 dist-test-slave-92m1 krb5kdc[24095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 22:55:17.264782 24216 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e7edec69e646f9a7a1616c96f965f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37207 } }
I20260809 22:55:17.265224 24216 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:17.265384 24216 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9e7edec69e646f9a7a1616c96f965f8, State: Initialized, Role: FOLLOWER
I20260809 22:55:17.266031 24216 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e7edec69e646f9a7a1616c96f965f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37207 } }
I20260809 22:55:17.266301 24216 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:17.266297 24221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:17.242854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45995 (local address 127.0.0.1:37207)
0809 22:55:17.243716 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:17.243727 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:17.243770 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:55:17.245892 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:17.245915 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:17.246324 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:17.246715 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:17.248477 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:17.249817 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:17.251293 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:17.252053 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:17.252258 (+ 205us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:17.257238 (+ 4980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:17.257246 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:17.257266 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:17.257316 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:17.260834 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:17.262010 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:17.262017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:17.262047 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:17.262269 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:17.262799 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:17.262802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:17.262804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:17.263554 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:17.263829 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:17.264399 (+ 570us) server_negotiation.cc:299] Negotiation successful
0809 22:55:17.264759 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":436,"threads_started":1}
I20260809 22:55:17.266464 24216 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:17.266659 24216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:17.269407 24216 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e7edec69e646f9a7a1616c96f965f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37207 } }
I20260809 22:55:17.269969 24216 leader_election.cc:302] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9e7edec69e646f9a7a1616c96f965f8; no voters:
I20260809 22:55:17.270715 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:17.270710 24216 leader_election.cc:288] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:17.270838 24224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:17.273432 24216 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:17.276244 24224 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [term 1 LEADER]: Becoming Leader. State: Replica: c9e7edec69e646f9a7a1616c96f965f8, State: Running, Role: LEADER
I20260809 22:55:17.277055 24224 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e7edec69e646f9a7a1616c96f965f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37207 } }
I20260809 22:55:17.280936 24226 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9e7edec69e646f9a7a1616c96f965f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e7edec69e646f9a7a1616c96f965f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37207 } } }
I20260809 22:55:17.281445 24226 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:17.282013 24228 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9e7edec69e646f9a7a1616c96f965f8. Latest consensus state: current_term: 1 leader_uuid: "c9e7edec69e646f9a7a1616c96f965f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e7edec69e646f9a7a1616c96f965f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37207 } } }
I20260809 22:55:17.282351 24228 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:17.284958 24247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:17.292349 24247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:17.296692 24221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:17.277006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56263 (local address 127.0.0.1:37207)
0809 22:55:17.277266 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:17.277274 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:17.277292 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:55:17.277383 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:17.277390 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:17.277469 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:17.277592 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:17.279915 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:17.280882 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:17.282936 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:17.283731 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:17.283860 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:17.287439 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:17.287449 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:17.287457 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:17.287511 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:17.291971 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:17.293163 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:17.293168 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:17.293172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:17.293329 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:17.293975 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:17.293981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:17.293985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:17.294448 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:17.295825 (+ 1377us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:17.296042 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 22:55:17.296252 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260809 22:55:17.304538 24247 catalog_manager.cc:1347] Generated new cluster ID: 2bd916bd5886437a912cc862b0b8cf8f
I20260809 22:55:17.304665 24247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:17.325052 24247 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:17.326453 24247 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:17.338850 24247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9e7edec69e646f9a7a1616c96f965f8: Generated new TSK 0
I20260809 22:55:17.339834 24247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:17.357620 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24111
I20260809 22:55:17.359828 24208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:17.455703 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24111
W20260809 22:55:17.483688 24092 connection.cc:535] client connection to 127.0.0.1:37207 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37207): Connection reset by peer (error 104)
2026-08-09T22:55:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2501 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:17 dist-test-slave-92m1 krb5kdc[24274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:17 dist-test-slave-92m1 krb5kdc[24274](info): set up 2 sockets
Aug 09 22:55:17 dist-test-slave-92m1 krb5kdc[24274](info): commencing operation
krb5kdc: starting...
W20260809 22:55:18.839643 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:19 dist-test-slave-92m1 krb5kdc[24274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:19.239136 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:19.604616 24293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:19.604931 24293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:19.605052 24293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:19.612512 24293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:19.612653 24293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:19.612704 24293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:19.612769 24293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:19.612814 24293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:19.623064 24293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37405
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:19.624455 24293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:19.625710 24293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:19.638446 24304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:19.638943 24299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:19.638876 24302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:19.639966 24293 server_base.cc:1034] running on GCE node
I20260809 22:55:19.640873 24293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:19.642330 24293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:19.643570 24293 hybrid_clock.cc:648] HybridClock initialized: now 1786316119643506 us; error 43 us; skew 500 ppm
I20260809 22:55:19.643990 24293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:19 dist-test-slave-92m1 krb5kdc[24274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316119, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:19.652215 24293 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:19.654044 24293 webserver.cc:460] Webserver started at http://127.0.0.1:46091/ using document root <none> and password file <none>
I20260809 22:55:19.654827 24293 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:19.654942 24293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:19.655279 24293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:19.658494 24293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "99af36e7882b4a119fafbe4b99a39b81"
format_stamp: "Formatted at 2026-08-09 22:55:19 on dist-test-slave-92m1"
server_key: "0419349ef29befb28e88cec0ca2f7f3b"
server_key_iv: "acb76ba917eb04b2e388dbaf48b93494"
server_key_version: "encryptionkey@0"
I20260809 22:55:19.659333 24293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "99af36e7882b4a119fafbe4b99a39b81"
format_stamp: "Formatted at 2026-08-09 22:55:19 on dist-test-slave-92m1"
server_key: "0419349ef29befb28e88cec0ca2f7f3b"
server_key_iv: "acb76ba917eb04b2e388dbaf48b93494"
server_key_version: "encryptionkey@0"
I20260809 22:55:19.665066 24293 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:55:19.668835 24315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:19.670270 24293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 22:55:19.670463 24293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "99af36e7882b4a119fafbe4b99a39b81"
format_stamp: "Formatted at 2026-08-09 22:55:19 on dist-test-slave-92m1"
server_key: "0419349ef29befb28e88cec0ca2f7f3b"
server_key_iv: "acb76ba917eb04b2e388dbaf48b93494"
server_key_version: "encryptionkey@0"
I20260809 22:55:19.670643 24293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:19.703321 24293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:19.708022 24293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:19.708290 24293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:19.728502 24293 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37405
I20260809 22:55:19.728534 24390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37405 every 8 connection(s)
I20260809 22:55:19.729967 24293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:19.733819 24391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:19.740235 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24293
I20260809 22:55:19.740417 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:19.740830 24077 external_mini_cluster.cc:1428] Setting key 2e331eb4d8b1c598a4a2e4eae0055511
I20260809 22:55:19.745255 24391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81: Bootstrap starting.
I20260809 22:55:19.748898 24391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:19.750250 24391 log.cc:824] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:19.753851 24391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81: No bootstrap required, opened a new log
I20260809 22:55:19.755854 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:19.742857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57859 (local address 127.0.0.1:37405)
0809 22:55:19.743829 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:19.743842 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:19.743884 (+ 42us) server_negotiation.cc:407] Connection header received
0809 22:55:19.745750 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:19.745775 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:19.746161 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:19.746488 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:19.747186 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:19.748543 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:19.750544 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:19.751751 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:19.751972 (+ 221us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:19.753249 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:19.753257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:19.753270 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:19.753801 (+ 531us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:19.753897 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:19.753922 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:19.754091 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:19.754563 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 22:55:19.754770 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":531,"threads_started":1}
I20260809 22:55:19.760349 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:19.763643 24391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99af36e7882b4a119fafbe4b99a39b81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37405 } }
I20260809 22:55:19.764226 24391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:19.764366 24391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99af36e7882b4a119fafbe4b99a39b81, State: Initialized, Role: FOLLOWER
I20260809 22:55:19.765121 24391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99af36e7882b4a119fafbe4b99a39b81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37405 } }
I20260809 22:55:19.765424 24391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:19.765591 24391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:19.765797 24391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:19.769002 24391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99af36e7882b4a119fafbe4b99a39b81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37405 } }
I20260809 22:55:19.769650 24391 leader_election.cc:302] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99af36e7882b4a119fafbe4b99a39b81; no voters:
I20260809 22:55:19.770350 24391 leader_election.cc:288] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:19.770462 24409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:19.772755 24391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:19.774787 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:19.765987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41921 (local address 127.0.0.1:37405)
0809 22:55:19.766203 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:19.766211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:19.766782 (+ 571us) server_negotiation.cc:407] Connection header received
0809 22:55:19.766984 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:19.766988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:19.767055 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:19.767142 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:19.767821 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:19.768623 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:19.770702 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:19.771524 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:19.771666 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:19.773344 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:19.773351 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:19.773359 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:19.773389 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:19.773435 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:19.773457 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:19.773590 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:19.774182 (+ 592us) server_negotiation.cc:299] Negotiation successful
0809 22:55:19.774259 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 22:55:19.776324 24409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [term 1 LEADER]: Becoming Leader. State: Replica: 99af36e7882b4a119fafbe4b99a39b81, State: Running, Role: LEADER
I20260809 22:55:19.776969 24409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99af36e7882b4a119fafbe4b99a39b81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37405 } }
I20260809 22:55:19.780217 24412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99af36e7882b4a119fafbe4b99a39b81. Latest consensus state: current_term: 1 leader_uuid: "99af36e7882b4a119fafbe4b99a39b81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99af36e7882b4a119fafbe4b99a39b81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37405 } } }
I20260809 22:55:19.780236 24411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99af36e7882b4a119fafbe4b99a39b81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99af36e7882b4a119fafbe4b99a39b81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37405 } } }
I20260809 22:55:19.780778 24411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:19.780778 24412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:19.784365 24422 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:19.791429 24422 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:19.801004 24422 catalog_manager.cc:1347] Generated new cluster ID: 321c6c76b5454b92b0a67b345d418464
I20260809 22:55:19.801137 24422 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:19.816715 24422 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:19.818099 24422 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:19.837390 24422 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99af36e7882b4a119fafbe4b99a39b81: Generated new TSK 0
I20260809 22:55:19.838928 24422 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:19.853677 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24293
W20260809 22:55:19.855551 24386 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57859
W20260809 22:55:19.856405 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24293: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:19.856647 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24293
W20260809 22:55:19.885989 24270 connection.cc:535] client connection to 127.0.0.1:37405 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37405): Connection reset by peer (error 104)
2026-08-09T22:55:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:19 dist-test-slave-92m1 krb5kdc[24443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:19 dist-test-slave-92m1 krb5kdc[24443](info): set up 2 sockets
Aug 09 22:55:19 dist-test-slave-92m1 krb5kdc[24443](info): commencing operation
krb5kdc: starting...
W20260809 22:55:21.253695 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.348s user 0.000s sys 0.068s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:21 dist-test-slave-92m1 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:21.638397 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:21.996302 24460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:21.996691 24460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:21.996869 24460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:22.004348 24460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:22.004545 24460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:22.004684 24460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:22.004796 24460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:22.004884 24460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:22.015234 24460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41671
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:22.016705 24460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:22.018095 24460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:22.030537 24467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:22.030508 24466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:22.030928 24472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:22.031347 24460 server_base.cc:1034] running on GCE node
I20260809 22:55:22.032162 24460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:22.033646 24460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:22.034883 24460 hybrid_clock.cc:648] HybridClock initialized: now 1786316122034847 us; error 54 us; skew 500 ppm
I20260809 22:55:22.035310 24460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:22 dist-test-slave-92m1 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316122, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:22.038599 24460 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:22.040135 24460 webserver.cc:460] Webserver started at http://127.0.0.1:35621/ using document root <none> and password file <none>
I20260809 22:55:22.040797 24460 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:22.040899 24460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:22.041157 24460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:22.044260 24460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c95b9d880f9d4082bab3f088afc41699"
format_stamp: "Formatted at 2026-08-09 22:55:22 on dist-test-slave-92m1"
server_key: "540d0c89093499c38de65ad23cb7d952"
server_key_iv: "6f47e3140fc58079d72e0e39b88c13c3"
server_key_version: "encryptionkey@0"
I20260809 22:55:22.045010 24460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c95b9d880f9d4082bab3f088afc41699"
format_stamp: "Formatted at 2026-08-09 22:55:22 on dist-test-slave-92m1"
server_key: "540d0c89093499c38de65ad23cb7d952"
server_key_iv: "6f47e3140fc58079d72e0e39b88c13c3"
server_key_version: "encryptionkey@0"
I20260809 22:55:22.050414 24460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:55:22.053960 24484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:22.055358 24460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:22.055565 24460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c95b9d880f9d4082bab3f088afc41699"
format_stamp: "Formatted at 2026-08-09 22:55:22 on dist-test-slave-92m1"
server_key: "540d0c89093499c38de65ad23cb7d952"
server_key_iv: "6f47e3140fc58079d72e0e39b88c13c3"
server_key_version: "encryptionkey@0"
I20260809 22:55:22.055784 24460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:22.061630 24460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:22.066195 24460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:22.066504 24460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:22.085990 24460 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41671
I20260809 22:55:22.086123 24555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41671 every 8 connection(s)
I20260809 22:55:22.087566 24460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:22.091553 24558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:22.096472 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24460
I20260809 22:55:22.096688 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:22.097182 24077 external_mini_cluster.cc:1428] Setting key 7e2726a3231eb3e9a7cc70f8169df378
I20260809 22:55:22.102969 24558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699: Bootstrap starting.
I20260809 22:55:22.105139 24562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:22.099062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57279 (local address 127.0.0.1:41671)
0809 22:55:22.099900 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:22.099914 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:22.099954 (+ 40us) server_negotiation.cc:407] Connection header received
0809 22:55:22.101794 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:22.101816 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:22.102136 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:22.102510 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:22.103599 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:22.103605 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:22.103617 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:22.103631 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:22.103686 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:22.103705 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:22.103939 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:22.104071 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 22:55:22.104259 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":361,"threads_started":1}
I20260809 22:55:22.106407 24558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:22.107661 24558 log.cc:824] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:22.109015 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:22.110658 24558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699: No bootstrap required, opened a new log
I20260809 22:55:22.116245 24562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:22.113548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36921 (local address 127.0.0.1:41671)
0809 22:55:22.113735 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:22.113742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:22.114185 (+ 443us) server_negotiation.cc:407] Connection header received
0809 22:55:22.114315 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:22.114320 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:22.114382 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:22.114493 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:22.115529 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:22.115535 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:22.115540 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:22.115563 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:22.115609 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:22.115631 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:22.115753 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:22.115866 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 22:55:22.115922 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:55:22.119714 24558 raft_consensus.cc:348] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95b9d880f9d4082bab3f088afc41699" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41671 } }
I20260809 22:55:22.120064 24558 raft_consensus.cc:374] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:22.120141 24558 raft_consensus.cc:729] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95b9d880f9d4082bab3f088afc41699, State: Initialized, Role: FOLLOWER
I20260809 22:55:22.120643 24558 consensus_queue.cc:260] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95b9d880f9d4082bab3f088afc41699" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41671 } }
I20260809 22:55:22.120898 24558 raft_consensus.cc:388] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:22.121018 24558 raft_consensus.cc:482] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:22.121151 24558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:22.123915 24558 raft_consensus.cc:504] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95b9d880f9d4082bab3f088afc41699" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41671 } }
I20260809 22:55:22.124383 24558 leader_election.cc:302] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c95b9d880f9d4082bab3f088afc41699; no voters:
I20260809 22:55:22.125005 24558 leader_election.cc:288] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:22.125229 24572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:22.126019 24572 raft_consensus.cc:686] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [term 1 LEADER]: Becoming Leader. State: Replica: c95b9d880f9d4082bab3f088afc41699, State: Running, Role: LEADER
I20260809 22:55:22.126641 24572 consensus_queue.cc:237] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95b9d880f9d4082bab3f088afc41699" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41671 } }
I20260809 22:55:22.127151 24558 sys_catalog.cc:564] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:22.129848 24574 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c95b9d880f9d4082bab3f088afc41699" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95b9d880f9d4082bab3f088afc41699" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41671 } } }
I20260809 22:55:22.130308 24574 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:22.130854 24575 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95b9d880f9d4082bab3f088afc41699. Latest consensus state: current_term: 1 leader_uuid: "c95b9d880f9d4082bab3f088afc41699" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95b9d880f9d4082bab3f088afc41699" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41671 } } }
I20260809 22:55:22.131273 24575 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:22.133273 24581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:22.139705 24581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:22.148873 24581 catalog_manager.cc:1347] Generated new cluster ID: 3e9a1e16918f4a789c5a86e73eff8088
I20260809 22:55:22.149017 24581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:22.179482 24581 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:22.180016 24581 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:22.192695 24581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c95b9d880f9d4082bab3f088afc41699: Generated new TSK 0
I20260809 22:55:22.193888 24581 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:22.204438 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24460
W20260809 22:55:22.206212 24547 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57279
W20260809 22:55:22.206959 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24460: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:22.207132 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24460
2026-08-09T22:55:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2353 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:22 dist-test-slave-92m1 krb5kdc[24608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:22 dist-test-slave-92m1 krb5kdc[24608](info): set up 2 sockets
Aug 09 22:55:22 dist-test-slave-92m1 krb5kdc[24608](info): commencing operation
krb5kdc: starting...
W20260809 22:55:23.628360 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.370s user 0.000s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:23 dist-test-slave-92m1 krb5kdc[24608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:24.028187 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42759
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:24.389789 24626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:24.390108 24626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:24.390305 24626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:24.397810 24626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:24.397964 24626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:24.398082 24626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:24.398211 24626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:24.398286 24626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:24.408756 24626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:24.410203 24626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:24.411649 24626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:24.424568 24633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:24.424573 24637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:24.424621 24634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:24.425886 24626 server_base.cc:1034] running on GCE node
I20260809 22:55:24.426725 24626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:24.428251 24626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:24.429458 24626 hybrid_clock.cc:648] HybridClock initialized: now 1786316124429418 us; error 30 us; skew 500 ppm
I20260809 22:55:24.429795 24626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:24 dist-test-slave-92m1 krb5kdc[24608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316124, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:24.433115 24626 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:24.434582 24626 webserver.cc:460] Webserver started at http://127.0.0.1:33753/ using document root <none> and password file <none>
I20260809 22:55:24.435293 24626 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:24.435406 24626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:24.435662 24626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:24.438684 24626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "93dffda3348144c4927423a585006f07"
format_stamp: "Formatted at 2026-08-09 22:55:24 on dist-test-slave-92m1"
server_key: "f6d99142707ead4fc7bcc2d608c1ef4e"
server_key_iv: "b7fe1b4546abd5b9aa56975aacccd224"
server_key_version: "encryptionkey@0"
I20260809 22:55:24.439514 24626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "93dffda3348144c4927423a585006f07"
format_stamp: "Formatted at 2026-08-09 22:55:24 on dist-test-slave-92m1"
server_key: "f6d99142707ead4fc7bcc2d608c1ef4e"
server_key_iv: "b7fe1b4546abd5b9aa56975aacccd224"
server_key_version: "encryptionkey@0"
I20260809 22:55:24.444932 24626 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 22:55:24.448535 24650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:24.449892 24626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 22:55:24.450045 24626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "93dffda3348144c4927423a585006f07"
format_stamp: "Formatted at 2026-08-09 22:55:24 on dist-test-slave-92m1"
server_key: "f6d99142707ead4fc7bcc2d608c1ef4e"
server_key_iv: "b7fe1b4546abd5b9aa56975aacccd224"
server_key_version: "encryptionkey@0"
I20260809 22:55:24.450217 24626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:24.469260 24626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:24.473724 24626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:24.473984 24626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:24.493765 24626 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42759
I20260809 22:55:24.493811 24743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42759 every 8 connection(s)
I20260809 22:55:24.495263 24626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:24.497967 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24626
I20260809 22:55:24.498193 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:24.498834 24077 external_mini_cluster.cc:1428] Setting key dcf3bb685a548765ed96e8fc22ebc564
I20260809 22:55:24.499903 24744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:55:24 dist-test-slave-92m1 krb5kdc[24608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 22:55:24.515017 24744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07: Bootstrap starting.
I20260809 22:55:24.518698 24744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:24.520282 24744 log.cc:824] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:24.523105 24749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:24.500770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45059 (local address 127.0.0.1:42759)
0809 22:55:24.501591 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:24.501601 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:24.501640 (+ 39us) server_negotiation.cc:407] Connection header received
0809 22:55:24.503323 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:24.503344 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:24.503734 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:24.504050 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:24.505923 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:24.507463 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:24.509227 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:24.509903 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:24.510029 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:24.515112 (+ 5083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:24.515120 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:24.515136 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:24.515214 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:24.518345 (+ 3131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:24.519176 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:24.519187 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:24.519196 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:24.519501 (+ 305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:24.519994 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:24.519999 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:24.520003 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:24.520745 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:24.521118 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:24.521712 (+ 594us) server_negotiation.cc:299] Negotiation successful
0809 22:55:24.522112 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":391,"threads_started":1}
I20260809 22:55:24.523703 24744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07: No bootstrap required, opened a new log
I20260809 22:55:24.526911 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:24.531764 24744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dffda3348144c4927423a585006f07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42759 } }
I20260809 22:55:24.532192 24744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:24.532320 24744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93dffda3348144c4927423a585006f07, State: Initialized, Role: FOLLOWER
I20260809 22:55:24.532981 24744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dffda3348144c4927423a585006f07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42759 } }
I20260809 22:55:24.533245 24744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:24.533406 24744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:24.533597 24744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:24.536005 24744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dffda3348144c4927423a585006f07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42759 } }
I20260809 22:55:24.536517 24744 leader_election.cc:302] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93dffda3348144c4927423a585006f07; no voters:
I20260809 22:55:24.537215 24744 leader_election.cc:288] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:24.537322 24762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:24.538674 24762 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [term 1 LEADER]: Becoming Leader. State: Replica: 93dffda3348144c4927423a585006f07, State: Running, Role: LEADER
I20260809 22:55:24.539304 24762 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dffda3348144c4927423a585006f07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42759 } }
I20260809 22:55:24.539665 24744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:24.542702 24763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93dffda3348144c4927423a585006f07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dffda3348144c4927423a585006f07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42759 } } }
I20260809 22:55:24.542665 24764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93dffda3348144c4927423a585006f07. Latest consensus state: current_term: 1 leader_uuid: "93dffda3348144c4927423a585006f07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dffda3348144c4927423a585006f07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42759 } } }
I20260809 22:55:24.543102 24764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:24.543102 24763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:24.552379 24749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:24.531586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51257 (local address 127.0.0.1:42759)
0809 22:55:24.531811 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:24.531817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:24.532300 (+ 483us) server_negotiation.cc:407] Connection header received
0809 22:55:24.532507 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:24.532514 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:24.532593 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:24.532736 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:24.534564 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:24.535416 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:24.536772 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:24.537621 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:24.537782 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:24.541420 (+ 3638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:24.541427 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:24.541433 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:24.541483 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:24.546931 (+ 5448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:24.548285 (+ 1354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:24.548294 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:24.548300 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:24.548502 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:24.549109 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:24.549117 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:24.549122 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:24.549622 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:24.551270 (+ 1648us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:24.551469 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 22:55:24.551786 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 22:55:24.557619 24776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:24.563153 24776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:24.572225 24776 catalog_manager.cc:1347] Generated new cluster ID: f29395dcb1e74e6d89d962c3876a8ad5
I20260809 22:55:24.572360 24776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:24.600340 24776 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:24.601763 24776 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:24.613063 24776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93dffda3348144c4927423a585006f07: Generated new TSK 0
I20260809 22:55:24.613902 24776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:24.625000 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24626
I20260809 22:55:24.626075 24738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:24.723572 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24626
2026-08-09T22:55:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2508 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:24 dist-test-slave-92m1 krb5kdc[24794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:24 dist-test-slave-92m1 krb5kdc[24794](info): set up 2 sockets
Aug 09 22:55:24 dist-test-slave-92m1 krb5kdc[24794](info): commencing operation
krb5kdc: starting...
W20260809 22:55:26.110025 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:26 dist-test-slave-92m1 krb5kdc[24794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:26.518560 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:26.901726 24815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:26.902047 24815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:26.902161 24815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:26.909597 24815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:26.909739 24815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:26.909787 24815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:26.909852 24815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:26.909894 24815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:26.920759 24815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:26.922186 24815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:26.923566 24815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:26.935817 24822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:26.935767 24826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:26.935814 24830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:26.936821 24815 server_base.cc:1034] running on GCE node
I20260809 22:55:26.937672 24815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:26.939266 24815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:26.940487 24815 hybrid_clock.cc:648] HybridClock initialized: now 1786316126940428 us; error 52 us; skew 500 ppm
I20260809 22:55:26.940882 24815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:26 dist-test-slave-92m1 krb5kdc[24794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316126, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:26.944178 24815 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:26.945719 24815 webserver.cc:460] Webserver started at http://127.0.0.1:43707/ using document root <none> and password file <none>
I20260809 22:55:26.946431 24815 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:26.946586 24815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:26.946918 24815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:26.950311 24815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "fdb3c474c9f744a38ffcf946048a8fee"
format_stamp: "Formatted at 2026-08-09 22:55:26 on dist-test-slave-92m1"
server_key: "6855b2c578b3ddbc19904d1c6c4c3cab"
server_key_iv: "cf74c7543bd4135573dd1a7e3639c348"
server_key_version: "encryptionkey@0"
I20260809 22:55:26.951130 24815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "fdb3c474c9f744a38ffcf946048a8fee"
format_stamp: "Formatted at 2026-08-09 22:55:26 on dist-test-slave-92m1"
server_key: "6855b2c578b3ddbc19904d1c6c4c3cab"
server_key_iv: "cf74c7543bd4135573dd1a7e3639c348"
server_key_version: "encryptionkey@0"
I20260809 22:55:26.956714 24815 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 22:55:26.960394 24840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:26.961762 24815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 22:55:26.961956 24815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "fdb3c474c9f744a38ffcf946048a8fee"
format_stamp: "Formatted at 2026-08-09 22:55:26 on dist-test-slave-92m1"
server_key: "6855b2c578b3ddbc19904d1c6c4c3cab"
server_key_iv: "cf74c7543bd4135573dd1a7e3639c348"
server_key_version: "encryptionkey@0"
I20260809 22:55:26.962172 24815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:26.985374 24815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:26.990458 24815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:26.990796 24815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:27.010968 24815 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40129
I20260809 22:55:27.011006 24923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40129 every 8 connection(s)
I20260809 22:55:27.012408 24815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:27.016266 24926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:27.019665 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24815
I20260809 22:55:27.019872 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:27.020460 24077 external_mini_cluster.cc:1428] Setting key 427f98ef5299f79633ba673646661681
I20260809 22:55:27.028594 24926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee: Bootstrap starting.
I20260809 22:55:27.031988 24926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:27.033247 24926 log.cc:824] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:27.034322 24930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:27.022457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42797 (local address 127.0.0.1:40129)
0809 22:55:27.023362 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:27.023374 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:27.023416 (+ 42us) server_negotiation.cc:407] Connection header received
0809 22:55:27.025129 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:27.025152 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:27.025581 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:27.026011 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:27.026611 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:27.028017 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:27.029446 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:27.030160 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:27.030369 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:27.031653 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:27.031661 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:27.031676 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:27.032296 (+ 620us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:27.032379 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:27.032413 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:27.032556 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:27.032796 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 22:55:27.033072 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":382,"threads_started":1}
I20260809 22:55:27.036582 24926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee: No bootstrap required, opened a new log
I20260809 22:55:27.038151 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:27.044911 24926 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3c474c9f744a38ffcf946048a8fee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40129 } }
I20260809 22:55:27.045413 24926 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:27.045531 24926 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb3c474c9f744a38ffcf946048a8fee, State: Initialized, Role: FOLLOWER
I20260809 22:55:27.046221 24926 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3c474c9f744a38ffcf946048a8fee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40129 } }
I20260809 22:55:27.046506 24926 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:27.046653 24926 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:27.046833 24926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:27.049507 24930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:27.042735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43373 (local address 127.0.0.1:40129)
0809 22:55:27.042974 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:27.042981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:27.043375 (+ 394us) server_negotiation.cc:407] Connection header received
0809 22:55:27.043543 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:27.043546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:27.043624 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:27.043708 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:27.044293 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:27.044993 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:27.046968 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:27.047509 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:27.047624 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:27.048791 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:27.048795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:27.048799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:27.048820 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:27.048863 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:27.048878 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:27.048949 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:27.049117 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 22:55:27.049193 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:55:27.050110 24926 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3c474c9f744a38ffcf946048a8fee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40129 } }
I20260809 22:55:27.050658 24926 leader_election.cc:302] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdb3c474c9f744a38ffcf946048a8fee; no voters:
I20260809 22:55:27.051352 24926 leader_election.cc:288] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:27.051460 24939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:27.052237 24939 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [term 1 LEADER]: Becoming Leader. State: Replica: fdb3c474c9f744a38ffcf946048a8fee, State: Running, Role: LEADER
I20260809 22:55:27.052827 24939 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3c474c9f744a38ffcf946048a8fee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40129 } }
I20260809 22:55:27.053787 24926 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:27.055999 24940 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdb3c474c9f744a38ffcf946048a8fee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3c474c9f744a38ffcf946048a8fee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40129 } } }
I20260809 22:55:27.056071 24941 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdb3c474c9f744a38ffcf946048a8fee. Latest consensus state: current_term: 1 leader_uuid: "fdb3c474c9f744a38ffcf946048a8fee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3c474c9f744a38ffcf946048a8fee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40129 } } }
I20260809 22:55:27.056480 24940 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:27.056517 24941 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:27.058101 24946 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:27.064724 24946 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:27.077682 24946 catalog_manager.cc:1347] Generated new cluster ID: d5fb1809b6ac49bb97743707678f7f39
I20260809 22:55:27.077831 24946 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:27.085544 24946 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:27.087427 24946 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:27.105993 24946 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdb3c474c9f744a38ffcf946048a8fee: Generated new TSK 0
I20260809 22:55:27.106905 24946 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:27.120700 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24815
W20260809 22:55:27.121959 24919 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42797
W20260809 22:55:27.122661 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24815: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:27.122821 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24815
2026-08-09T22:55:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2402 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:27 dist-test-slave-92m1 krb5kdc[24974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:27 dist-test-slave-92m1 krb5kdc[24974](info): set up 2 sockets
Aug 09 22:55:27 dist-test-slave-92m1 krb5kdc[24974](info): commencing operation
krb5kdc: starting...
W20260809 22:55:28.501943 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.001s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:28 dist-test-slave-92m1 krb5kdc[24974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:28.913816 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34543
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:29.285781 24991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:29.286197 24991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:29.286372 24991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:29.294193 24991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:29.294397 24991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:29.294516 24991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:29.294665 24991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:29.294749 24991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:29.305292 24991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:29.306792 24991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:29.308228 24991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:29.321269 24998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:29.321148 25001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:29.321209 24999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:29.322150 24991 server_base.cc:1034] running on GCE node
I20260809 22:55:29.323030 24991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:29.324627 24991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:29.325868 24991 hybrid_clock.cc:648] HybridClock initialized: now 1786316129325804 us; error 59 us; skew 500 ppm
I20260809 22:55:29.326273 24991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:29 dist-test-slave-92m1 krb5kdc[24974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316129, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:29.329778 24991 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:29.331562 24991 webserver.cc:460] Webserver started at http://127.0.0.1:39973/ using document root <none> and password file <none>
I20260809 22:55:29.332289 24991 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:29.332399 24991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:29.332695 24991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:29.335976 24991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "608d23691cdc401b8e7abf5c67f363a2"
format_stamp: "Formatted at 2026-08-09 22:55:29 on dist-test-slave-92m1"
server_key: "96e9a46b25552de1735b0f208b9634db"
server_key_iv: "0d1c10624f5d35bc1588935d168cd0ed"
server_key_version: "encryptionkey@0"
I20260809 22:55:29.336795 24991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "608d23691cdc401b8e7abf5c67f363a2"
format_stamp: "Formatted at 2026-08-09 22:55:29 on dist-test-slave-92m1"
server_key: "96e9a46b25552de1735b0f208b9634db"
server_key_iv: "0d1c10624f5d35bc1588935d168cd0ed"
server_key_version: "encryptionkey@0"
I20260809 22:55:29.342285 24991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:55:29.345862 25013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:29.347194 24991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:29.347436 24991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "608d23691cdc401b8e7abf5c67f363a2"
format_stamp: "Formatted at 2026-08-09 22:55:29 on dist-test-slave-92m1"
server_key: "96e9a46b25552de1735b0f208b9634db"
server_key_iv: "0d1c10624f5d35bc1588935d168cd0ed"
server_key_version: "encryptionkey@0"
I20260809 22:55:29.347658 24991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:29.353498 24991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:29.357607 24991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:29.357924 24991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:29.378134 24991 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34543
I20260809 22:55:29.378232 25089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34543 every 8 connection(s)
I20260809 22:55:29.379822 24991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:29.383792 25091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:29.388092 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 24991
I20260809 22:55:29.388300 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:29.388804 24077 external_mini_cluster.cc:1428] Setting key bcc38e410f7f07cb5971250aa1bc1ef1
I20260809 22:55:29.396793 25094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:29.390690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58105 (local address 127.0.0.1:34543)
0809 22:55:29.391581 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:29.391593 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:29.391634 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:55:29.393340 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:29.393364 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:29.393725 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:29.394079 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:29.395183 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:29.395190 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:29.395258 (+ 68us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:29.395275 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:29.395341 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:29.395362 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:29.395547 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:29.395649 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 22:55:29.395849 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":395,"threads_started":1}
I20260809 22:55:29.397717 25091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2: Bootstrap starting.
I20260809 22:55:29.400626 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:29.401307 25091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:29.402347 25091 log.cc:824] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:29.405822 25091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2: No bootstrap required, opened a new log
I20260809 22:55:29.408020 25094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:29.405382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34113 (local address 127.0.0.1:34543)
0809 22:55:29.405594 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:29.405601 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:29.405942 (+ 341us) server_negotiation.cc:407] Connection header received
0809 22:55:29.406138 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:29.406145 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:29.406197 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:29.406312 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:29.407333 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:29.407341 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:29.407346 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:29.407364 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:29.407418 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:29.407436 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:29.407591 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:29.407691 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 22:55:29.407752 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 22:55:29.414192 25091 raft_consensus.cc:348] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "608d23691cdc401b8e7abf5c67f363a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260809 22:55:29.414623 25091 raft_consensus.cc:374] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:29.414744 25091 raft_consensus.cc:729] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608d23691cdc401b8e7abf5c67f363a2, State: Initialized, Role: FOLLOWER
I20260809 22:55:29.415426 25091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "608d23691cdc401b8e7abf5c67f363a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260809 22:55:29.415692 25091 raft_consensus.cc:388] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:29.415858 25091 raft_consensus.cc:482] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:29.416081 25091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:29.418475 25091 raft_consensus.cc:504] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "608d23691cdc401b8e7abf5c67f363a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260809 22:55:29.419004 25091 leader_election.cc:302] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 608d23691cdc401b8e7abf5c67f363a2; no voters:
I20260809 22:55:29.419705 25091 leader_election.cc:288] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:29.419865 25103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:29.420683 25103 raft_consensus.cc:686] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [term 1 LEADER]: Becoming Leader. State: Replica: 608d23691cdc401b8e7abf5c67f363a2, State: Running, Role: LEADER
I20260809 22:55:29.421357 25103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "608d23691cdc401b8e7abf5c67f363a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } }
I20260809 22:55:29.422183 25091 sys_catalog.cc:564] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:29.424638 25104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "608d23691cdc401b8e7abf5c67f363a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "608d23691cdc401b8e7abf5c67f363a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } } }
I20260809 22:55:29.424988 25104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:29.425529 25106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 608d23691cdc401b8e7abf5c67f363a2. Latest consensus state: current_term: 1 leader_uuid: "608d23691cdc401b8e7abf5c67f363a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "608d23691cdc401b8e7abf5c67f363a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34543 } } }
I20260809 22:55:29.425905 25106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:29.426056 25114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:29.432590 25114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:29.440969 25114 catalog_manager.cc:1347] Generated new cluster ID: a5d4a4f32f2c42c8bfe208dee0678f5a
I20260809 22:55:29.441108 25114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:29.511780 25114 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:29.512310 25114 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:29.524696 25114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 608d23691cdc401b8e7abf5c67f363a2: Generated new TSK 0
I20260809 22:55:29.525607 25114 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:29.555910 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24991
W20260809 22:55:29.557541 25080 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58105
W20260809 22:55:29.558359 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 24991: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:29.558528 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 24991
2026-08-09T22:55:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2434 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:29 dist-test-slave-92m1 krb5kdc[25136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:29 dist-test-slave-92m1 krb5kdc[25136](info): set up 2 sockets
Aug 09 22:55:29 dist-test-slave-92m1 krb5kdc[25136](info): commencing operation
krb5kdc: starting...
W20260809 22:55:30.955611 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.350s user 0.000s sys 0.068s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:31 dist-test-slave-92m1 krb5kdc[25136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:31.354101 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45847
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:31.723781 25156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:31.724102 25156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:31.724213 25156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:31.731812 25156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:31.731954 25156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:31.732003 25156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:31.732077 25156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:31.732115 25156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:31.742457 25156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:31.743896 25156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:31.745225 25156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:31.757820 25161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:31.757699 25162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:31.757781 25167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:31.758785 25156 server_base.cc:1034] running on GCE node
I20260809 22:55:31.759744 25156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:31.761300 25156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:31.762547 25156 hybrid_clock.cc:648] HybridClock initialized: now 1786316131762501 us; error 49 us; skew 500 ppm
I20260809 22:55:31.762938 25156 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:31 dist-test-slave-92m1 krb5kdc[25136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316131, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:31.771639 25156 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:31.773391 25156 webserver.cc:460] Webserver started at http://127.0.0.1:33965/ using document root <none> and password file <none>
I20260809 22:55:31.774107 25156 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:31.774219 25156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:31.774485 25156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:31.777781 25156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "33682bd274c54cf18f93b0e933fa164c"
format_stamp: "Formatted at 2026-08-09 22:55:31 on dist-test-slave-92m1"
server_key: "8aec01990f8563883f92102e24b507c5"
server_key_iv: "16346c6f954465d4f0aebfee8b424fb8"
server_key_version: "encryptionkey@0"
I20260809 22:55:31.778690 25156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "33682bd274c54cf18f93b0e933fa164c"
format_stamp: "Formatted at 2026-08-09 22:55:31 on dist-test-slave-92m1"
server_key: "8aec01990f8563883f92102e24b507c5"
server_key_iv: "16346c6f954465d4f0aebfee8b424fb8"
server_key_version: "encryptionkey@0"
I20260809 22:55:31.785393 25156 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.001s
I20260809 22:55:31.789362 25179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:31.790897 25156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:31.791092 25156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "33682bd274c54cf18f93b0e933fa164c"
format_stamp: "Formatted at 2026-08-09 22:55:31 on dist-test-slave-92m1"
server_key: "8aec01990f8563883f92102e24b507c5"
server_key_iv: "16346c6f954465d4f0aebfee8b424fb8"
server_key_version: "encryptionkey@0"
I20260809 22:55:31.791363 25156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:31.833086 25156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:31.838013 25156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:31.838359 25156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:31.859876 25156 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45847
I20260809 22:55:31.859974 25263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45847 every 8 connection(s)
I20260809 22:55:31.861377 25156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:31.864331 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25156
I20260809 22:55:31.864538 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:31.864997 24077 external_mini_cluster.cc:1428] Setting key a0c62bb325af49a215b83a040e9f2def
I20260809 22:55:31.866578 25264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:55:31 dist-test-slave-92m1 krb5kdc[25136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 22:55:31.884840 25264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c: Bootstrap starting.
I20260809 22:55:31.889815 25264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:31.890053 25272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:31.866971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:51053 (local address 127.0.0.1:45847)
0809 22:55:31.867844 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:31.867856 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:31.867897 (+ 41us) server_negotiation.cc:407] Connection header received
0809 22:55:31.869662 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:31.869685 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:31.870107 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:31.870526 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:31.872320 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:31.873756 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:31.875191 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:31.875979 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:31.876224 (+ 245us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:31.880859 (+ 4635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:31.880868 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:31.880885 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:31.880931 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:31.885339 (+ 4408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:31.886282 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:31.886291 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:31.886299 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:31.886522 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:31.887035 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:31.887040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:31.887044 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:31.887672 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:31.888021 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:31.888601 (+ 580us) server_negotiation.cc:299] Negotiation successful
0809 22:55:31.888963 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":419,"threads_started":1}
I20260809 22:55:31.891470 25264 log.cc:824] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:31.894457 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:31.895628 25264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c: No bootstrap required, opened a new log
I20260809 22:55:31.905319 25264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33682bd274c54cf18f93b0e933fa164c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45847 } }
I20260809 22:55:31.905876 25264 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:31.906001 25264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33682bd274c54cf18f93b0e933fa164c, State: Initialized, Role: FOLLOWER
I20260809 22:55:31.906848 25264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33682bd274c54cf18f93b0e933fa164c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45847 } }
I20260809 22:55:31.907166 25264 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:31.907351 25264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:31.907550 25264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:31.909935 25264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33682bd274c54cf18f93b0e933fa164c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45847 } }
I20260809 22:55:31.910652 25264 leader_election.cc:302] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33682bd274c54cf18f93b0e933fa164c; no voters:
I20260809 22:55:31.911550 25264 leader_election.cc:288] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:31.911695 25286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:31.913100 25286 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [term 1 LEADER]: Becoming Leader. State: Replica: 33682bd274c54cf18f93b0e933fa164c, State: Running, Role: LEADER
I20260809 22:55:31.913769 25286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33682bd274c54cf18f93b0e933fa164c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45847 } }
I20260809 22:55:31.914331 25264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:31.916429 25272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:31.899820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:49989 (local address 127.0.0.1:45847)
0809 22:55:31.900061 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:31.900071 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:31.900487 (+ 416us) server_negotiation.cc:407] Connection header received
0809 22:55:31.900667 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:31.900670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:31.900734 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:31.900817 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:31.902832 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:31.903789 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:31.905567 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:31.906170 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:31.906276 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:31.909213 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:31.909218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:31.909222 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:31.909255 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:31.912900 (+ 3645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:31.914005 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:31.914009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:31.914011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:31.914241 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:31.914733 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:31.914738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:31.914741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:31.915092 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:31.915494 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:31.915851 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 22:55:31.916061 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 22:55:31.918570 25288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33682bd274c54cf18f93b0e933fa164c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33682bd274c54cf18f93b0e933fa164c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45847 } } }
I20260809 22:55:31.919064 25288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:31.919592 25289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33682bd274c54cf18f93b0e933fa164c. Latest consensus state: current_term: 1 leader_uuid: "33682bd274c54cf18f93b0e933fa164c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33682bd274c54cf18f93b0e933fa164c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45847 } } }
I20260809 22:55:31.920089 25289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:31.923146 25302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:31.931684 25302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:31.943656 25302 catalog_manager.cc:1347] Generated new cluster ID: 19fe2011160b4933a9b39db9867667ad
I20260809 22:55:31.943794 25302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:31.963315 25302 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:31.965267 25302 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:31.992914 25302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33682bd274c54cf18f93b0e933fa164c: Generated new TSK 0
I20260809 22:55:31.993839 25302 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:32.004280 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25156
I20260809 22:55:32.005774 25257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:32.101981 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25156
W20260809 22:55:32.127490 25130 connection.cc:535] client connection to 127.0.0.1:45847 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45847): Connection reset by peer (error 104)
2026-08-09T22:55:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2543 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:32 dist-test-slave-92m1 krb5kdc[25319](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:32 dist-test-slave-92m1 krb5kdc[25319](info): set up 2 sockets
Aug 09 22:55:32 dist-test-slave-92m1 krb5kdc[25319](info): commencing operation
krb5kdc: starting...
W20260809 22:55:33.485311 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.004s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:33 dist-test-slave-92m1 krb5kdc[25319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:33.894995 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36287
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:34.265460 25338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:34.265779 25338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:34.265874 25338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:34.273289 25338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:34.273447 25338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:34.273506 25338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:34.273577 25338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:34.273623 25338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:34.283987 25338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:34.285305 25338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:34.286943 25338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:34.299485 25348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:34.299711 25351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:34.299752 25349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:34.300575 25338 server_base.cc:1034] running on GCE node
I20260809 22:55:34.301376 25338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:34.302762 25338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:34.303961 25338 hybrid_clock.cc:648] HybridClock initialized: now 1786316134303921 us; error 29 us; skew 500 ppm
I20260809 22:55:34.304317 25338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:34 dist-test-slave-92m1 krb5kdc[25319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:34.307631 25338 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:34.309088 25338 webserver.cc:460] Webserver started at http://127.0.0.1:35689/ using document root <none> and password file <none>
I20260809 22:55:34.309733 25338 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:34.309835 25338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:34.310086 25338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:34.313161 25338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "ff01a3a90f0d4468ba00cfebd1fe3161"
format_stamp: "Formatted at 2026-08-09 22:55:34 on dist-test-slave-92m1"
server_key: "2fb227215ad10b07496a5ed6e2c2e4c3"
server_key_iv: "38b59deea3607791cdcb9e5891db4411"
server_key_version: "encryptionkey@0"
I20260809 22:55:34.313902 25338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "ff01a3a90f0d4468ba00cfebd1fe3161"
format_stamp: "Formatted at 2026-08-09 22:55:34 on dist-test-slave-92m1"
server_key: "2fb227215ad10b07496a5ed6e2c2e4c3"
server_key_iv: "38b59deea3607791cdcb9e5891db4411"
server_key_version: "encryptionkey@0"
I20260809 22:55:34.319272 25338 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:55:34.322793 25360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:34.324229 25338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:34.324429 25338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "ff01a3a90f0d4468ba00cfebd1fe3161"
format_stamp: "Formatted at 2026-08-09 22:55:34 on dist-test-slave-92m1"
server_key: "2fb227215ad10b07496a5ed6e2c2e4c3"
server_key_iv: "38b59deea3607791cdcb9e5891db4411"
server_key_version: "encryptionkey@0"
I20260809 22:55:34.324649 25338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:34.357776 25338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:34.362022 25338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:34.362347 25338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:34.382243 25338 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36287
I20260809 22:55:34.382283 25447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36287 every 8 connection(s)
I20260809 22:55:34.383714 25338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:34.385605 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25338
I20260809 22:55:34.385813 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:34.386266 24077 external_mini_cluster.cc:1428] Setting key 05980d0b70fb212d634074fcc8e8cee9
I20260809 22:55:34.388164 25448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:34.402030 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:34.388239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:45087 (local address 127.0.0.1:36287)
0809 22:55:34.389171 (+ 932us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:34.389185 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:34.389236 (+ 51us) server_negotiation.cc:407] Connection header received
0809 22:55:34.391506 (+ 2270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:34.391535 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:34.392079 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:34.392520 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:34.393060 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:34.395151 (+ 2091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:34.396464 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:34.397536 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:34.397727 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:34.398973 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:34.398985 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:34.399009 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:34.399828 (+ 819us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:34.399932 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:34.399974 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:34.400157 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:34.400469 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 22:55:34.400657 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":352,"threads_started":1}
I20260809 22:55:34.403695 25448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161: Bootstrap starting.
I20260809 22:55:34.406224 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:34.407449 25448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:34.408517 25448 log.cc:824] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:34.411690 25448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161: No bootstrap required, opened a new log
I20260809 22:55:34.417824 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:34.411232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:52147 (local address 127.0.0.1:36287)
0809 22:55:34.411413 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:34.411419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:34.411858 (+ 439us) server_negotiation.cc:407] Connection header received
0809 22:55:34.412089 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:34.412093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:34.412172 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:34.412289 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:34.412830 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:34.413626 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:34.415022 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:34.415552 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:34.415732 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:34.417025 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:34.417030 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:34.417034 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:34.417056 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:34.417100 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:34.417128 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:34.417267 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:34.417474 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 22:55:34.417538 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 22:55:34.420269 25448 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 22:55:34.420661 25448 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:34.420800 25448 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff01a3a90f0d4468ba00cfebd1fe3161, State: Initialized, Role: FOLLOWER
I20260809 22:55:34.421433 25448 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 22:55:34.421682 25448 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:34.421841 25448 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:34.422049 25448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:34.424769 25448 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 22:55:34.425315 25448 leader_election.cc:302] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff01a3a90f0d4468ba00cfebd1fe3161; no voters:
I20260809 22:55:34.425850 25448 leader_election.cc:288] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:34.426004 25468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:34.426869 25468 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [term 1 LEADER]: Becoming Leader. State: Replica: ff01a3a90f0d4468ba00cfebd1fe3161, State: Running, Role: LEADER
I20260809 22:55:34.427429 25468 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 22:55:34.428267 25448 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:34.430593 25470 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } } }
I20260809 22:55:34.430575 25472 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff01a3a90f0d4468ba00cfebd1fe3161. Latest consensus state: current_term: 1 leader_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff01a3a90f0d4468ba00cfebd1fe3161" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } } }
I20260809 22:55:34.431113 25470 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:34.431124 25472 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:34.432124 25476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:34.437983 25476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:34.448701 25476 catalog_manager.cc:1347] Generated new cluster ID: 58cb4e031aa1449db1d4ed6952d853a9
I20260809 22:55:34.448840 25476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:34.473508 25476 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:34.475147 25476 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:34.493736 25476 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff01a3a90f0d4468ba00cfebd1fe3161: Generated new TSK 0
I20260809 22:55:34.494612 25476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:34.503156 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25338
W20260809 22:55:34.504510 25439 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.238:45087
W20260809 22:55:34.505270 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25338: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:34.505420 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25338
W20260809 22:55:34.532013 25317 connection.cc:535] client connection to 127.0.0.1:36287 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36287): Connection reset by peer (error 104)
2026-08-09T22:55:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2404 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:34 dist-test-slave-92m1 krb5kdc[25500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:34 dist-test-slave-92m1 krb5kdc[25500](info): set up 2 sockets
Aug 09 22:55:34 dist-test-slave-92m1 krb5kdc[25500](info): commencing operation
krb5kdc: starting...
W20260809 22:55:35.896790 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.004s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:36 dist-test-slave-92m1 krb5kdc[25500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:36.306770 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43969
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:36.680613 25515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:36.680933 25515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:36.681041 25515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:36.688551 25515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:36.688685 25515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:36.688735 25515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:36.688800 25515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:36.688848 25515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:36.699353 25515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:36.700716 25515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:36.702026 25515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:36.714555 25524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:36.714596 25525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:36.714799 25529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:36.716076 25515 server_base.cc:1034] running on GCE node
I20260809 22:55:36.717061 25515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:36.718593 25515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:36.719803 25515 hybrid_clock.cc:648] HybridClock initialized: now 1786316136719743 us; error 63 us; skew 500 ppm
I20260809 22:55:36.720194 25515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:36 dist-test-slave-92m1 krb5kdc[25500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316136, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:36.730304 25515 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:36.732054 25515 webserver.cc:460] Webserver started at http://127.0.0.1:44727/ using document root <none> and password file <none>
I20260809 22:55:36.732793 25515 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:36.732952 25515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:36.733284 25515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:36.736529 25515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "ff1f1738d00c44eb81ee6d96b6623b2c"
format_stamp: "Formatted at 2026-08-09 22:55:36 on dist-test-slave-92m1"
server_key: "fe4476147cfbc8f69f549ce2d46909ff"
server_key_iv: "aedeb0ff1de3f262085eb5f8a835c8f0"
server_key_version: "encryptionkey@0"
I20260809 22:55:36.737354 25515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "ff1f1738d00c44eb81ee6d96b6623b2c"
format_stamp: "Formatted at 2026-08-09 22:55:36 on dist-test-slave-92m1"
server_key: "fe4476147cfbc8f69f549ce2d46909ff"
server_key_iv: "aedeb0ff1de3f262085eb5f8a835c8f0"
server_key_version: "encryptionkey@0"
I20260809 22:55:36.742925 25515 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 22:55:36.746632 25541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:36.748117 25515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:36.748325 25515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "ff1f1738d00c44eb81ee6d96b6623b2c"
format_stamp: "Formatted at 2026-08-09 22:55:36 on dist-test-slave-92m1"
server_key: "fe4476147cfbc8f69f549ce2d46909ff"
server_key_iv: "aedeb0ff1de3f262085eb5f8a835c8f0"
server_key_version: "encryptionkey@0"
I20260809 22:55:36.748562 25515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:36.754776 25515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:36.759815 25515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:36.760156 25515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:36.780493 25515 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43969
I20260809 22:55:36.780542 25632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43969 every 8 connection(s)
I20260809 22:55:36.781951 25515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:36.785744 25636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:36.788707 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25515
I20260809 22:55:36.788916 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:36.789373 24077 external_mini_cluster.cc:1428] Setting key d46e5c3e56d1e2dcb57eb6c8fe4323d5
I20260809 22:55:36.797879 25636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c: Bootstrap starting.
I20260809 22:55:36.801241 25636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:36.802501 25636 log.cc:824] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:36.803133 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:36.791336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:50985 (local address 127.0.0.1:43969)
0809 22:55:36.792142 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:36.792154 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:36.792194 (+ 40us) server_negotiation.cc:407] Connection header received
0809 22:55:36.793913 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:36.793936 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:36.794370 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:36.794780 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:36.801324 (+ 6544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:36.801331 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:36.801345 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:36.801385 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:36.801474 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:36.801506 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:36.801740 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:36.801879 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 22:55:36.802090 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":343,"threads_started":1}
I20260809 22:55:36.805733 25636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c: No bootstrap required, opened a new log
I20260809 22:55:36.807039 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:36.814317 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:36.811653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:41095 (local address 127.0.0.1:43969)
0809 22:55:36.811896 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:36.811903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:36.812283 (+ 380us) server_negotiation.cc:407] Connection header received
0809 22:55:36.812469 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:36.812473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:36.812525 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:36.812609 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:36.813632 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:36.813636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:36.813639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:36.813655 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:36.813699 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:36.813715 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:36.813820 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:36.813952 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 22:55:36.814004 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 22:55:36.814880 25636 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43969 } }
I20260809 22:55:36.815452 25636 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:36.815585 25636 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1f1738d00c44eb81ee6d96b6623b2c, State: Initialized, Role: FOLLOWER
I20260809 22:55:36.816256 25636 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43969 } }
I20260809 22:55:36.816522 25636 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:36.816686 25636 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:36.816882 25636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:36.819187 25636 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43969 } }
I20260809 22:55:36.819782 25636 leader_election.cc:302] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff1f1738d00c44eb81ee6d96b6623b2c; no voters:
I20260809 22:55:36.820372 25636 leader_election.cc:288] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:36.820514 25652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:36.822157 25652 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [term 1 LEADER]: Becoming Leader. State: Replica: ff1f1738d00c44eb81ee6d96b6623b2c, State: Running, Role: LEADER
I20260809 22:55:36.822815 25652 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43969 } }
I20260809 22:55:36.822964 25636 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:36.826148 25655 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff1f1738d00c44eb81ee6d96b6623b2c. Latest consensus state: current_term: 1 leader_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43969 } } }
I20260809 22:55:36.826692 25655 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:36.826333 25653 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff1f1738d00c44eb81ee6d96b6623b2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43969 } } }
I20260809 22:55:36.827437 25653 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:36.827975 25667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:36.834290 25667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:36.844787 25667 catalog_manager.cc:1347] Generated new cluster ID: 71469bffcda04e11a6dbabbf7bca7ce9
I20260809 22:55:36.844939 25667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:36.864785 25667 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:36.865274 25667 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:36.876564 25667 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff1f1738d00c44eb81ee6d96b6623b2c: Generated new TSK 0
I20260809 22:55:36.877467 25667 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:36.885650 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25515
W20260809 22:55:36.886811 25626 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.238:50985
W20260809 22:55:36.887714 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25515: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:36.887861 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25515
2026-08-09T22:55:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:37 dist-test-slave-92m1 krb5kdc[25681](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:37 dist-test-slave-92m1 krb5kdc[25681](info): set up 2 sockets
Aug 09 22:55:37 dist-test-slave-92m1 krb5kdc[25681](info): commencing operation
krb5kdc: starting...
W20260809 22:55:38.275838 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.069s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:38 dist-test-slave-92m1 krb5kdc[25681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:38.686838 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35901
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:39.057039 25700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:39.057343 25700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:39.057458 25700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:39.064826 25700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:39.064954 25700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:39.065004 25700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:39.065081 25700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:39.065127 25700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:39.075631 25700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35901
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:39.076874 25700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:39.078187 25700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:39.090229 25707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:39.090267 25708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:39.090188 25713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:39.091192 25700 server_base.cc:1034] running on GCE node
I20260809 22:55:39.092011 25700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:39.093411 25700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:39.094659 25700 hybrid_clock.cc:648] HybridClock initialized: now 1786316139094615 us; error 53 us; skew 500 ppm
I20260809 22:55:39.095000 25700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:39 dist-test-slave-92m1 krb5kdc[25681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316139, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:39.098229 25700 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:39.099833 25700 webserver.cc:460] Webserver started at http://127.0.0.1:35993/ using document root <none> and password file <none>
I20260809 22:55:39.100529 25700 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:39.100677 25700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:39.100983 25700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:39.104205 25700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "73129fb854a940e7bc3374789072ed8f"
format_stamp: "Formatted at 2026-08-09 22:55:39 on dist-test-slave-92m1"
server_key: "3f758b438ad1226b467fe7f381dfd129"
server_key_iv: "030682fa511201ad8ec549be2a39c2d9"
server_key_version: "encryptionkey@0"
I20260809 22:55:39.105060 25700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "73129fb854a940e7bc3374789072ed8f"
format_stamp: "Formatted at 2026-08-09 22:55:39 on dist-test-slave-92m1"
server_key: "3f758b438ad1226b467fe7f381dfd129"
server_key_iv: "030682fa511201ad8ec549be2a39c2d9"
server_key_version: "encryptionkey@0"
I20260809 22:55:39.110632 25700 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:55:39.114357 25722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:39.115826 25700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:39.116024 25700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "73129fb854a940e7bc3374789072ed8f"
format_stamp: "Formatted at 2026-08-09 22:55:39 on dist-test-slave-92m1"
server_key: "3f758b438ad1226b467fe7f381dfd129"
server_key_iv: "030682fa511201ad8ec549be2a39c2d9"
server_key_version: "encryptionkey@0"
I20260809 22:55:39.116237 25700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:39.144373 25700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:39.148572 25700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:39.148885 25700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:39.168725 25700 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35901
I20260809 22:55:39.168761 25802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35901 every 8 connection(s)
I20260809 22:55:39.170169 25700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:39.170745 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25700
I20260809 22:55:39.170941 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:39.171564 24077 external_mini_cluster.cc:1428] Setting key 155fa169a0fb08416c55cdd9abf5fb03
I20260809 22:55:39.174578 25803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:55:39 dist-test-slave-92m1 krb5kdc[25681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 22:55:39.188086 25803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f: Bootstrap starting.
I20260809 22:55:39.192409 25803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:39.193722 25803 log.cc:824] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:39.197170 25809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:39.173510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:40405 (local address 127.0.0.1:35901)
0809 22:55:39.174310 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:39.174321 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:39.174359 (+ 38us) server_negotiation.cc:407] Connection header received
0809 22:55:39.176109 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:39.176129 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:39.176491 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:39.176805 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:39.178660 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:39.180094 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:39.181958 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:39.182595 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:39.182741 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:39.187982 (+ 5241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:39.187993 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:39.188011 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:39.188056 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:39.192015 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:39.192973 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:39.192982 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:39.192990 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:39.193198 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:39.193660 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:39.193668 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:39.193672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:39.194420 (+ 748us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:39.194708 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:39.195514 (+ 806us) server_negotiation.cc:299] Negotiation successful
0809 22:55:39.195844 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":381,"threads_started":1}
I20260809 22:55:39.197383 25803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f: No bootstrap required, opened a new log
I20260809 22:55:39.201475 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:39.206070 25803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73129fb854a940e7bc3374789072ed8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35901 } }
I20260809 22:55:39.206606 25803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:39.206729 25803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73129fb854a940e7bc3374789072ed8f, State: Initialized, Role: FOLLOWER
I20260809 22:55:39.207543 25803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73129fb854a940e7bc3374789072ed8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35901 } }
I20260809 22:55:39.207859 25803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:39.208031 25803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:39.208230 25803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:39.211376 25803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73129fb854a940e7bc3374789072ed8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35901 } }
I20260809 22:55:39.211999 25803 leader_election.cc:302] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73129fb854a940e7bc3374789072ed8f; no voters:
I20260809 22:55:39.212764 25803 leader_election.cc:288] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:39.212889 25819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:39.215361 25819 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [term 1 LEADER]: Becoming Leader. State: Replica: 73129fb854a940e7bc3374789072ed8f, State: Running, Role: LEADER
I20260809 22:55:39.216105 25819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73129fb854a940e7bc3374789072ed8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35901 } }
I20260809 22:55:39.217317 25803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:39.219358 25822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73129fb854a940e7bc3374789072ed8f. Latest consensus state: current_term: 1 leader_uuid: "73129fb854a940e7bc3374789072ed8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73129fb854a940e7bc3374789072ed8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35901 } } }
I20260809 22:55:39.219846 25822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:39.222157 25830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:39.223537 25809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:39.205959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:44153 (local address 127.0.0.1:35901)
0809 22:55:39.206197 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:39.206206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:39.206604 (+ 398us) server_negotiation.cc:407] Connection header received
0809 22:55:39.206803 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:39.206807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:39.206886 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:39.206984 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:39.209205 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:39.210023 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:39.211815 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:39.212376 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:39.212550 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:39.215152 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:39.215160 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:39.215168 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:39.215234 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:39.219070 (+ 3836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:39.220168 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:39.220174 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:39.220178 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:39.220416 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:39.221061 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:39.221064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:39.221066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:39.221517 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:39.222928 (+ 1411us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:39.223062 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 22:55:39.223194 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:55:39.224696 25820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73129fb854a940e7bc3374789072ed8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73129fb854a940e7bc3374789072ed8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35901 } } }
I20260809 22:55:39.225133 25820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:39.229401 25830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:39.240613 25830 catalog_manager.cc:1347] Generated new cluster ID: 635f83c594924971a2f7fdf11afa8ed8
I20260809 22:55:39.240756 25830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:39.261317 25830 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:39.262730 25830 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:39.272583 25830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73129fb854a940e7bc3374789072ed8f: Generated new TSK 0
I20260809 22:55:39.273463 25830 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:39.279914 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25700
I20260809 22:55:39.281133 25798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:39.375481 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25700
W20260809 22:55:39.399621 25679 connection.cc:535] client connection to 127.0.0.1:35901 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35901): Connection reset by peer (error 104)
2026-08-09T22:55:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:39 dist-test-slave-92m1 krb5kdc[25849](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:39 dist-test-slave-92m1 krb5kdc[25849](info): set up 2 sockets
Aug 09 22:55:39 dist-test-slave-92m1 krb5kdc[25849](info): commencing operation
krb5kdc: starting...
W20260809 22:55:40.758531 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.001s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:41 dist-test-slave-92m1 krb5kdc[25849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:41.166709 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46701
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:41.526196 25872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:41.526517 25872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:41.526615 25872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:41.533926 25872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:41.534050 25872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:41.534098 25872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:41.534165 25872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:41.534211 25872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:41.547534 25872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46701
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:41.548835 25872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:41.550169 25872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:41.562685 25879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:41.562796 25878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:41.562849 25881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:41.563261 25872 server_base.cc:1034] running on GCE node
I20260809 22:55:41.564239 25872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:41.565754 25872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:41.566988 25872 hybrid_clock.cc:648] HybridClock initialized: now 1786316141566942 us; error 63 us; skew 500 ppm
I20260809 22:55:41.567451 25872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:41 dist-test-slave-92m1 krb5kdc[25849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316141, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:41.570773 25872 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:41.572347 25872 webserver.cc:460] Webserver started at http://127.0.0.1:32841/ using document root <none> and password file <none>
I20260809 22:55:41.573071 25872 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:41.573227 25872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:41.573550 25872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:41.576809 25872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "1e85f149ff244d6483c0037062a0ba89"
format_stamp: "Formatted at 2026-08-09 22:55:41 on dist-test-slave-92m1"
server_key: "1d30db6223d0a497eb0f47a641b41710"
server_key_iv: "c2e76b39caaa8531db8b4b2a3b2d9162"
server_key_version: "encryptionkey@0"
I20260809 22:55:41.577651 25872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "1e85f149ff244d6483c0037062a0ba89"
format_stamp: "Formatted at 2026-08-09 22:55:41 on dist-test-slave-92m1"
server_key: "1d30db6223d0a497eb0f47a641b41710"
server_key_iv: "c2e76b39caaa8531db8b4b2a3b2d9162"
server_key_version: "encryptionkey@0"
I20260809 22:55:41.583165 25872 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 22:55:41.586776 25895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:41.588239 25872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:41.588439 25872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "1e85f149ff244d6483c0037062a0ba89"
format_stamp: "Formatted at 2026-08-09 22:55:41 on dist-test-slave-92m1"
server_key: "1d30db6223d0a497eb0f47a641b41710"
server_key_iv: "c2e76b39caaa8531db8b4b2a3b2d9162"
server_key_version: "encryptionkey@0"
I20260809 22:55:41.588663 25872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:41.600912 25872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:41.605484 25872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:41.605795 25872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:41.626561 25872 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46701
I20260809 22:55:41.626591 25975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46701 every 8 connection(s)
I20260809 22:55:41.628083 25872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:41.631791 25977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:41.636685 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 25872
I20260809 22:55:41.636888 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:41.637394 24077 external_mini_cluster.cc:1428] Setting key 371af14809fa8ebdc1256d8c6b9e3d3a
I20260809 22:55:41.644443 25977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89: Bootstrap starting.
I20260809 22:55:41.648360 25977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:41.649822 25977 log.cc:824] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:41.653460 25977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89: No bootstrap required, opened a new log
I20260809 22:55:41.653466 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:41.639296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:53919 (local address 127.0.0.1:46701)
0809 22:55:41.640179 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:41.640194 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:41.640243 (+ 49us) server_negotiation.cc:407] Connection header received
0809 22:55:41.642852 (+ 2609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:41.642881 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:41.643433 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:41.643871 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:41.644402 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:41.646408 (+ 2006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:41.648085 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:41.649236 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:41.649419 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:41.650686 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:41.650693 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:41.650707 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:41.651412 (+ 705us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:41.651513 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:41.651545 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:41.651709 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:41.651958 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 22:55:41.652145 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":351,"threads_started":1}
I20260809 22:55:41.658300 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:41.663156 25977 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e85f149ff244d6483c0037062a0ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46701 } }
I20260809 22:55:41.663714 25977 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:41.663841 25977 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e85f149ff244d6483c0037062a0ba89, State: Initialized, Role: FOLLOWER
I20260809 22:55:41.664518 25977 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e85f149ff244d6483c0037062a0ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46701 } }
I20260809 22:55:41.664793 25977 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:41.664959 25977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:41.665179 25977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:41.667624 25977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e85f149ff244d6483c0037062a0ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46701 } }
I20260809 22:55:41.668191 25977 leader_election.cc:302] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e85f149ff244d6483c0037062a0ba89; no voters:
I20260809 22:55:41.668951 25977 leader_election.cc:288] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:41.669077 25994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:41.669471 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:41.662938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:35303 (local address 127.0.0.1:46701)
0809 22:55:41.663161 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:41.663168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:41.663506 (+ 338us) server_negotiation.cc:407] Connection header received
0809 22:55:41.663731 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:41.663735 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:41.663797 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:41.663906 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:41.664431 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:41.665235 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:41.666586 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:41.667080 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:41.667263 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:41.668484 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:41.668489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:41.668492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:41.668511 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:41.668568 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:41.668585 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:41.668714 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:41.668931 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 22:55:41.669002 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 22:55:41.671491 25994 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [term 1 LEADER]: Becoming Leader. State: Replica: 1e85f149ff244d6483c0037062a0ba89, State: Running, Role: LEADER
I20260809 22:55:41.671945 25977 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:41.672137 25994 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e85f149ff244d6483c0037062a0ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46701 } }
I20260809 22:55:41.675702 25996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e85f149ff244d6483c0037062a0ba89. Latest consensus state: current_term: 1 leader_uuid: "1e85f149ff244d6483c0037062a0ba89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e85f149ff244d6483c0037062a0ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46701 } } }
I20260809 22:55:41.676115 25996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:41.677047 25995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e85f149ff244d6483c0037062a0ba89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e85f149ff244d6483c0037062a0ba89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46701 } } }
I20260809 22:55:41.677407 25995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:41.682336 26007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:41.688267 26007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:41.697217 26007 catalog_manager.cc:1347] Generated new cluster ID: 472027b81bab41a5810ddfe5d6a06b79
I20260809 22:55:41.697333 26007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:41.708923 26007 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:41.710834 26007 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:41.725417 26007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e85f149ff244d6483c0037062a0ba89: Generated new TSK 0
I20260809 22:55:41.726536 26007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:41.741194 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25872
W20260809 22:55:41.742292 25969 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.238:53919
W20260809 22:55:41.743041 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 25872: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:41.743193 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 25872
W20260809 22:55:41.772805 25847 connection.cc:535] client connection to 127.0.0.1:46701 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46701): Connection reset by peer (error 104)
2026-08-09T22:55:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2368 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:41 dist-test-slave-92m1 krb5kdc[26020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:41 dist-test-slave-92m1 krb5kdc[26020](info): set up 2 sockets
Aug 09 22:55:41 dist-test-slave-92m1 krb5kdc[26020](info): commencing operation
krb5kdc: starting...
W20260809 22:55:43.145977 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.353s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:43 dist-test-slave-92m1 krb5kdc[26020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 22:55:43.538830 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:43.908421 26044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:43.908717 26044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:43.908812 26044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:43.916270 26044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:43.916394 26044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:43.916456 26044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:43.916520 26044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:43.916565 26044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:43.926648 26044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:43.927983 26044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:43.929289 26044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:43.942077 26050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:43.942063 26052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:43.942279 26055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:43.943106 26044 server_base.cc:1034] running on GCE node
I20260809 22:55:43.943976 26044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:43.945353 26044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:43.946574 26044 hybrid_clock.cc:648] HybridClock initialized: now 1786316143946537 us; error 23 us; skew 500 ppm
I20260809 22:55:43.946888 26044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:43 dist-test-slave-92m1 krb5kdc[26020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316143, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:43.950048 26044 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 22:55:43.951562 26044 webserver.cc:460] Webserver started at http://127.0.0.1:40473/ using document root <none> and password file <none>
I20260809 22:55:43.952216 26044 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:43.952322 26044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:43.952584 26044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:43.955749 26044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "19cdb493cbce4fa295241df6ba94fd15"
format_stamp: "Formatted at 2026-08-09 22:55:43 on dist-test-slave-92m1"
server_key: "471b149dead7928734022c7e0cbf3d8d"
server_key_iv: "57bb84ab36635627a91e67fb7fc0bb0d"
server_key_version: "encryptionkey@0"
I20260809 22:55:43.956485 26044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "19cdb493cbce4fa295241df6ba94fd15"
format_stamp: "Formatted at 2026-08-09 22:55:43 on dist-test-slave-92m1"
server_key: "471b149dead7928734022c7e0cbf3d8d"
server_key_iv: "57bb84ab36635627a91e67fb7fc0bb0d"
server_key_version: "encryptionkey@0"
I20260809 22:55:43.961838 26044 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260809 22:55:43.965322 26067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:43.966672 26044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:43.966871 26044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "19cdb493cbce4fa295241df6ba94fd15"
format_stamp: "Formatted at 2026-08-09 22:55:43 on dist-test-slave-92m1"
server_key: "471b149dead7928734022c7e0cbf3d8d"
server_key_iv: "57bb84ab36635627a91e67fb7fc0bb0d"
server_key_version: "encryptionkey@0"
I20260809 22:55:43.967051 26044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:43.973254 26044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:43.977718 26044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:43.978055 26044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:43.997542 26044 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43785
I20260809 22:55:43.997639 26152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43785 every 8 connection(s)
I20260809 22:55:43.999153 26044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:43.999648 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26044
I20260809 22:55:43.999840 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:44.000547 24077 external_mini_cluster.cc:1428] Setting key 6d313eb7c0fdb8ad1e280654269517a7
I20260809 22:55:44.003847 26158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:44.008438 26161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:44.002347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:37201 (local address 127.0.0.1:43785)
0809 22:55:44.003164 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:44.003175 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:44.003279 (+ 104us) server_negotiation.cc:407] Connection header received
0809 22:55:44.004973 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:44.004995 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:44.005324 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:44.005639 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:44.006802 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:44.006808 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:44.006820 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:44.006835 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:44.006914 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:44.006933 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:44.007125 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:44.007309 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 22:55:44.007530 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":378,"threads_started":1}
I20260809 22:55:44.012288 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:44.015818 26158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15: Bootstrap starting.
I20260809 22:55:44.019629 26161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:44.017007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.238:55349 (local address 127.0.0.1:43785)
0809 22:55:44.017174 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:44.017179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:44.017578 (+ 399us) server_negotiation.cc:407] Connection header received
0809 22:55:44.017752 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:44.017756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:44.017801 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:44.017891 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:44.018890 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:44.018894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:44.018897 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:44.018911 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:44.018949 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:44.018963 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:44.019046 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:44.019269 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 22:55:44.019318 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 22:55:44.019934 26158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:44.021250 26158 log.cc:824] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:44.024120 26158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15: No bootstrap required, opened a new log
I20260809 22:55:44.031634 26158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cdb493cbce4fa295241df6ba94fd15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260809 22:55:44.032051 26158 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:44.032166 26158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19cdb493cbce4fa295241df6ba94fd15, State: Initialized, Role: FOLLOWER
I20260809 22:55:44.032758 26158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cdb493cbce4fa295241df6ba94fd15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260809 22:55:44.033013 26158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:44.033169 26158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:44.033351 26158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:44.035676 26158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cdb493cbce4fa295241df6ba94fd15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260809 22:55:44.036185 26158 leader_election.cc:302] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19cdb493cbce4fa295241df6ba94fd15; no voters:
I20260809 22:55:44.036861 26158 leader_election.cc:288] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:44.036979 26171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:44.038160 26171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [term 1 LEADER]: Becoming Leader. State: Replica: 19cdb493cbce4fa295241df6ba94fd15, State: Running, Role: LEADER
I20260809 22:55:44.038700 26171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cdb493cbce4fa295241df6ba94fd15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260809 22:55:44.039149 26158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:44.041653 26175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19cdb493cbce4fa295241df6ba94fd15. Latest consensus state: current_term: 1 leader_uuid: "19cdb493cbce4fa295241df6ba94fd15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cdb493cbce4fa295241df6ba94fd15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } } }
I20260809 22:55:44.042099 26175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:44.042587 26174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19cdb493cbce4fa295241df6ba94fd15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19cdb493cbce4fa295241df6ba94fd15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } } }
I20260809 22:55:44.042886 26174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:44.050465 26181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:44.056447 26181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:44.065588 26181 catalog_manager.cc:1347] Generated new cluster ID: 4bf455235f594baeb89b860cbf04e3a1
I20260809 22:55:44.065729 26181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:44.083613 26181 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:44.084048 26181 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:44.091771 26181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19cdb493cbce4fa295241df6ba94fd15: Generated new TSK 0
I20260809 22:55:44.092608 26181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:44.103457 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26044
W20260809 22:55:44.104529 26148 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.238:37201
W20260809 22:55:44.105211 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26044: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:44.105346 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26044
2026-08-09T22:55:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2360 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:44 dist-test-slave-92m1 krb5kdc[26203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:44 dist-test-slave-92m1 krb5kdc[26203](info): set up 2 sockets
Aug 09 22:55:44 dist-test-slave-92m1 krb5kdc[26203](info): commencing operation
krb5kdc: starting...
W20260809 22:55:45.483028 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.067s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:45 dist-test-slave-92m1 krb5kdc[26203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:45.883255 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39731
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:46603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:39731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:46.254717 26228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:46.255128 26228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:46.255342 26228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:46.263041 26228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:46.263252 26228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:46.263370 26228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:46.263487 26228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:46.263577 26228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:46.274302 26228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:46603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:39731
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:39731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:46.275790 26228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:46.277199 26228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:46.290027 26239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:46.290083 26237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:46.289969 26243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:46.291018 26228 server_base.cc:1034] running on GCE node
I20260809 22:55:46.292057 26228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:46.293591 26228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:46.294801 26228 hybrid_clock.cc:648] HybridClock initialized: now 1786316146294746 us; error 48 us; skew 500 ppm
I20260809 22:55:46.295240 26228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:46 dist-test-slave-92m1 krb5kdc[26203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316146, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:46.298514 26228 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:46.300194 26228 webserver.cc:460] Webserver started at http://127.23.131.126:33415/ using document root <none> and password file <none>
I20260809 22:55:46.300956 26228 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:46.301116 26228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:46.301455 26228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:46.304755 26228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c253ce9680f94535a59a9c7cb2d47cc9"
format_stamp: "Formatted at 2026-08-09 22:55:46 on dist-test-slave-92m1"
server_key: "9cb4adfdb9adfc5e000926c8d7159dbc"
server_key_iv: "fe3ec6a0b7402ca1f3c0563d7049af53"
server_key_version: "encryptionkey@0"
I20260809 22:55:46.305559 26228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c253ce9680f94535a59a9c7cb2d47cc9"
format_stamp: "Formatted at 2026-08-09 22:55:46 on dist-test-slave-92m1"
server_key: "9cb4adfdb9adfc5e000926c8d7159dbc"
server_key_iv: "fe3ec6a0b7402ca1f3c0563d7049af53"
server_key_version: "encryptionkey@0"
I20260809 22:55:46.311056 26228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:55:46.314599 26255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:46.315987 26228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:55:46.316190 26228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c253ce9680f94535a59a9c7cb2d47cc9"
format_stamp: "Formatted at 2026-08-09 22:55:46 on dist-test-slave-92m1"
server_key: "9cb4adfdb9adfc5e000926c8d7159dbc"
server_key_iv: "fe3ec6a0b7402ca1f3c0563d7049af53"
server_key_version: "encryptionkey@0"
I20260809 22:55:46.316396 26228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:46.341157 26228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:46.345369 26228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:46.345695 26228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:46.365588 26228 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:39731
I20260809 22:55:46.365625 26331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:39731 every 8 connection(s)
I20260809 22:55:46.367079 26228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:46.371069 26332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:46.375027 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26228
I20260809 22:55:46.375253 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:46.375715 24077 external_mini_cluster.cc:1428] Setting key b69e87d79387d6742a230ce2fd3fb796
I20260809 22:55:46.385082 26332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9: Bootstrap starting.
I20260809 22:55:46.389427 26332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:46.390965 26332 log.cc:824] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9: Log is configured to *not* fsync() on all Append() calls
Aug 09 22:55:46 dist-test-slave-92m1 krb5kdc[26203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:46.394999 26332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9: No bootstrap required, opened a new log
I20260809 22:55:46.402721 26336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:46.377805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53417 (local address 127.23.131.126:39731)
0809 22:55:46.378705 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:46.378717 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:46.378760 (+ 43us) server_negotiation.cc:407] Connection header received
0809 22:55:46.380531 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:46.380567 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:46.381042 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:46.381389 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:46.383512 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:46.384875 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:46.386704 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:46.387580 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:46.387732 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:46.393239 (+ 5507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:46.393251 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:46.393271 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:46.393324 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:46.397657 (+ 4333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:46.398565 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:46.398575 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:46.398590 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:46.398819 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:46.399284 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:46.399289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:46.399293 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:46.400067 (+ 774us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:46.400401 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:46.400835 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 22:55:46.401220 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":431,"threads_started":1}
I20260809 22:55:46.406220 26332 raft_consensus.cc:348] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39731 } }
I20260809 22:55:46.406706 26332 raft_consensus.cc:374] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:46.406814 26332 raft_consensus.cc:729] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c253ce9680f94535a59a9c7cb2d47cc9, State: Initialized, Role: FOLLOWER
I20260809 22:55:46.407289 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:46.407562 26332 consensus_queue.cc:260] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39731 } }
I20260809 22:55:46.407824 26332 raft_consensus.cc:388] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:46.408007 26332 raft_consensus.cc:482] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:46.408190 26332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:46.410468 26332 raft_consensus.cc:504] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39731 } }
I20260809 22:55:46.411026 26332 leader_election.cc:302] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c253ce9680f94535a59a9c7cb2d47cc9; no voters:
I20260809 22:55:46.411769 26332 leader_election.cc:288] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:46.411893 26348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:46.413829 26348 raft_consensus.cc:686] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [term 1 LEADER]: Becoming Leader. State: Replica: c253ce9680f94535a59a9c7cb2d47cc9, State: Running, Role: LEADER
I20260809 22:55:46.414544 26348 consensus_queue.cc:237] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39731 } }
I20260809 22:55:46.416464 26332 sys_catalog.cc:564] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:46.417860 26349 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c253ce9680f94535a59a9c7cb2d47cc9. Latest consensus state: current_term: 1 leader_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39731 } } }
I20260809 22:55:46.417886 26350 sys_catalog.cc:455] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c253ce9680f94535a59a9c7cb2d47cc9" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 39731 } } }
I20260809 22:55:46.418386 26349 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:46.418386 26350 sys_catalog.cc:458] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:46.419313 26358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:46.434710 26358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:46.438102 26336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:46.412336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35493 (local address 127.23.131.126:39731)
0809 22:55:46.412576 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:46.412586 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:46.413336 (+ 750us) server_negotiation.cc:407] Connection header received
0809 22:55:46.413567 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:46.413576 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:46.413696 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:46.413842 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:46.416144 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:46.417717 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:46.420176 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:46.421181 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:46.421326 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:46.426205 (+ 4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:46.426215 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:46.426223 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:46.426279 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:46.432307 (+ 6028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:46.433709 (+ 1402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:46.433719 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:46.433725 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:46.433962 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:46.434727 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:46.434735 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:46.434741 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:46.435340 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:46.435705 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:46.437242 (+ 1537us) server_negotiation.cc:299] Negotiation successful
0809 22:55:46.437523 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 22:55:46.452020 26358 catalog_manager.cc:1347] Generated new cluster ID: 24a63ec22fce4ecc84d503f9cff992ff
I20260809 22:55:46.452184 26358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:46.473531 26358 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:46.474858 26358 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:46.485035 26358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c253ce9680f94535a59a9c7cb2d47cc9: Generated new TSK 0
I20260809 22:55:46.485863 26358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:46.493712 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26228
I20260809 22:55:46.494868 26324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:46.588661 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26228
W20260809 22:55:46.620208 26201 connection.cc:535] client connection to 127.23.131.126:39731 recv error: Network error: failed to read from TLS socket (remote: 127.23.131.126:39731): Connection reset by peer (error 104)
2026-08-09T22:55:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:46 dist-test-slave-92m1 krb5kdc[26380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:46 dist-test-slave-92m1 krb5kdc[26380](info): set up 2 sockets
Aug 09 22:55:46 dist-test-slave-92m1 krb5kdc[26380](info): commencing operation
krb5kdc: starting...
W20260809 22:55:47.994232 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.354s user 0.004s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:48 dist-test-slave-92m1 krb5kdc[26380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:48.394793 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44699
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:48.763767 26400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:48.764142 26400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:48.764312 26400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:48.771629 26400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:48.771804 26400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:48.771903 26400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:48.772010 26400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:48.772100 26400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:48.782193 26400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44699
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:48.783715 26400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:48.785138 26400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:48.797698 26406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:48.797711 26409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:48.797641 26407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:48.798540 26400 server_base.cc:1034] running on GCE node
I20260809 22:55:48.799435 26400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:48.800900 26400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:48.802155 26400 hybrid_clock.cc:648] HybridClock initialized: now 1786316148802102 us; error 52 us; skew 500 ppm
I20260809 22:55:48.802510 26400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:48 dist-test-slave-92m1 krb5kdc[26380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316148, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:48.805817 26400 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:48.807395 26400 webserver.cc:460] Webserver started at http://127.23.131.126:35223/ using document root <none> and password file <none>
I20260809 22:55:48.808086 26400 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:48.808189 26400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:48.808449 26400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:48.811548 26400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "be4438d1a318460f9c68147702b1cf49"
format_stamp: "Formatted at 2026-08-09 22:55:48 on dist-test-slave-92m1"
server_key: "8b88e1bcac9c617d99ab9ea91942087b"
server_key_iv: "2e358844f6fb2ae4b4879777f1a1e041"
server_key_version: "encryptionkey@0"
I20260809 22:55:48.812296 26400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "be4438d1a318460f9c68147702b1cf49"
format_stamp: "Formatted at 2026-08-09 22:55:48 on dist-test-slave-92m1"
server_key: "8b88e1bcac9c617d99ab9ea91942087b"
server_key_iv: "2e358844f6fb2ae4b4879777f1a1e041"
server_key_version: "encryptionkey@0"
I20260809 22:55:48.817806 26400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:48.821422 26420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:48.822813 26400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:48.823011 26400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "be4438d1a318460f9c68147702b1cf49"
format_stamp: "Formatted at 2026-08-09 22:55:48 on dist-test-slave-92m1"
server_key: "8b88e1bcac9c617d99ab9ea91942087b"
server_key_iv: "2e358844f6fb2ae4b4879777f1a1e041"
server_key_version: "encryptionkey@0"
I20260809 22:55:48.823236 26400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:48.846787 26400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:48.851136 26400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:48.851506 26400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:48.871973 26400 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:44699
I20260809 22:55:48.872005 26491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:44699 every 8 connection(s)
I20260809 22:55:48.873445 26400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:48.875456 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26400
I20260809 22:55:48.875675 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:48.876166 24077 external_mini_cluster.cc:1428] Setting key a1a2cb9686b64b57b381b48333682251
I20260809 22:55:48.877938 26495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:48.889951 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:48.878064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50795 (local address 127.23.131.126:44699)
0809 22:55:48.878919 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:48.878930 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:48.878970 (+ 40us) server_negotiation.cc:407] Connection header received
0809 22:55:48.880678 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:48.880715 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:48.881089 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:48.881414 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:48.882056 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:48.883458 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:48.885390 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:48.886053 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:48.886186 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:48.887522 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:48.887529 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:48.887550 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:48.888155 (+ 605us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:48.888229 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:48.888258 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:48.888395 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:48.888719 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 22:55:48.888936 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":400,"threads_started":1}
I20260809 22:55:48.891809 26495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49: Bootstrap starting.
I20260809 22:55:48.894294 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:48.895503 26495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:48.896540 26495 log.cc:824] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:48.900214 26495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49: No bootstrap required, opened a new log
I20260809 22:55:48.906155 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:48.898995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54613 (local address 127.23.131.126:44699)
0809 22:55:48.899249 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:48.899259 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:48.899770 (+ 511us) server_negotiation.cc:407] Connection header received
0809 22:55:48.899961 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:48.899964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:48.900023 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:48.900102 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:48.900728 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:48.901520 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:48.903494 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:48.903980 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:48.904072 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:48.905344 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:48.905348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:48.905351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:48.905368 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:48.905402 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:48.905416 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:48.905502 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:48.905744 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 22:55:48.905811 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 22:55:48.909770 26495 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4438d1a318460f9c68147702b1cf49" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44699 } }
I20260809 22:55:48.910214 26495 raft_consensus.cc:374] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:48.910347 26495 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4438d1a318460f9c68147702b1cf49, State: Initialized, Role: FOLLOWER
I20260809 22:55:48.910970 26495 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4438d1a318460f9c68147702b1cf49" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44699 } }
I20260809 22:55:48.911212 26495 raft_consensus.cc:388] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:48.911393 26495 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:48.911579 26495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:48.913944 26495 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4438d1a318460f9c68147702b1cf49" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44699 } }
I20260809 22:55:48.914484 26495 leader_election.cc:302] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be4438d1a318460f9c68147702b1cf49; no voters:
I20260809 22:55:48.915261 26495 leader_election.cc:288] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:48.915428 26515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:48.916257 26515 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [term 1 LEADER]: Becoming Leader. State: Replica: be4438d1a318460f9c68147702b1cf49, State: Running, Role: LEADER
I20260809 22:55:48.916846 26515 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4438d1a318460f9c68147702b1cf49" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44699 } }
I20260809 22:55:48.917882 26495 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:48.920222 26518 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4438d1a318460f9c68147702b1cf49. Latest consensus state: current_term: 1 leader_uuid: "be4438d1a318460f9c68147702b1cf49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4438d1a318460f9c68147702b1cf49" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44699 } } }
I20260809 22:55:48.920197 26516 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be4438d1a318460f9c68147702b1cf49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4438d1a318460f9c68147702b1cf49" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44699 } } }
I20260809 22:55:48.920680 26518 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:48.920708 26516 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:48.922748 26524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:48.928134 26524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:48.939520 26524 catalog_manager.cc:1347] Generated new cluster ID: 53e5d4e232f14349a193d0816a2b3f07
I20260809 22:55:48.939667 26524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:48.958238 26524 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:48.959733 26524 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:48.967516 26524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be4438d1a318460f9c68147702b1cf49: Generated new TSK 0
I20260809 22:55:48.968894 26524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:48.984831 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26400
W20260809 22:55:48.986090 26486 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50795
W20260809 22:55:48.986969 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26400: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:48.987133 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26400
W20260809 22:55:49.013154 26377 connection.cc:535] client connection to 127.23.131.126:44699 recv error: Network error: failed to read from TLS socket (remote: 127.23.131.126:44699): Connection reset by peer (error 104)
2026-08-09T22:55:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:49 dist-test-slave-92m1 krb5kdc[26551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:49 dist-test-slave-92m1 krb5kdc[26551](info): set up 2 sockets
Aug 09 22:55:49 dist-test-slave-92m1 krb5kdc[26551](info): commencing operation
krb5kdc: starting...
W20260809 22:55:50.381258 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.000s sys 0.069s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:50 dist-test-slave-92m1 krb5kdc[26551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:50.779736 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:46703
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:33159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:46703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:51.146561 26570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:51.146903 26570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:51.146999 26570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:51.154881 26570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:51.155005 26570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:51.155086 26570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:51.155151 26570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:51.155242 26570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:51.166767 26570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:33159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:46703
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:46703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:51.168118 26570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:51.169545 26570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:51.182281 26579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:51.182300 26577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:51.182392 26576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:51.183633 26570 server_base.cc:1034] running on GCE node
I20260809 22:55:51.184576 26570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:51.186132 26570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:51.187328 26570 hybrid_clock.cc:648] HybridClock initialized: now 1786316151187292 us; error 53 us; skew 500 ppm
I20260809 22:55:51.187762 26570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:51 dist-test-slave-92m1 krb5kdc[26551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316151, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:51.191073 26570 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:51.192708 26570 webserver.cc:460] Webserver started at http://127.23.131.126:33189/ using document root <none> and password file <none>
I20260809 22:55:51.193452 26570 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:51.193608 26570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:51.193938 26570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:51.197275 26570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "bcde561467974661b14bf260c6e05648"
format_stamp: "Formatted at 2026-08-09 22:55:51 on dist-test-slave-92m1"
server_key: "0873115cc61cd9fb66813d127b525165"
server_key_iv: "3621928fda57ee58270b6b4e5ec3691f"
server_key_version: "encryptionkey@0"
I20260809 22:55:51.198108 26570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "bcde561467974661b14bf260c6e05648"
format_stamp: "Formatted at 2026-08-09 22:55:51 on dist-test-slave-92m1"
server_key: "0873115cc61cd9fb66813d127b525165"
server_key_iv: "3621928fda57ee58270b6b4e5ec3691f"
server_key_version: "encryptionkey@0"
I20260809 22:55:51.204107 26570 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 22:55:51.207813 26592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:51.209170 26570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 22:55:51.209355 26570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "bcde561467974661b14bf260c6e05648"
format_stamp: "Formatted at 2026-08-09 22:55:51 on dist-test-slave-92m1"
server_key: "0873115cc61cd9fb66813d127b525165"
server_key_iv: "3621928fda57ee58270b6b4e5ec3691f"
server_key_version: "encryptionkey@0"
I20260809 22:55:51.209574 26570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:51.215548 26570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:51.219751 26570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:51.220084 26570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:51.239861 26570 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:46703
I20260809 22:55:51.239903 26667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:46703 every 8 connection(s)
I20260809 22:55:51.241464 26570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:51.245262 26669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:51.250880 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26570
I20260809 22:55:51.251075 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:51.251577 24077 external_mini_cluster.cc:1428] Setting key 22593b76ec36f3d14cab173851787b4f
I20260809 22:55:51.256425 26669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648: Bootstrap starting.
I20260809 22:55:51.259720 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:51.253418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37437 (local address 127.23.131.126:46703)
0809 22:55:51.254421 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:51.254433 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:51.254475 (+ 42us) server_negotiation.cc:407] Connection header received
0809 22:55:51.256223 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:51.256245 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:51.256627 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:51.256944 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:51.258102 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:51.258108 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:51.258119 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:51.258141 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:51.258197 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:51.258219 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:51.258386 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:51.258568 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 22:55:51.258757 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":479,"threads_started":1}
I20260809 22:55:51.260274 26669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:51.261381 26669 log.cc:824] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:51.263375 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:51.264446 26669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648: No bootstrap required, opened a new log
I20260809 22:55:51.270798 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:51.268135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39733 (local address 127.23.131.126:46703)
0809 22:55:51.268315 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:51.268321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:51.268689 (+ 368us) server_negotiation.cc:407] Connection header received
0809 22:55:51.268884 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:51.268896 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:51.268945 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:51.269064 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:51.270071 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:51.270076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:51.270081 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:51.270106 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:51.270142 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:51.270160 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:51.270297 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:51.270429 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 22:55:51.270504 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 22:55:51.273257 26669 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcde561467974661b14bf260c6e05648" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 46703 } }
I20260809 22:55:51.273655 26669 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:51.273782 26669 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcde561467974661b14bf260c6e05648, State: Initialized, Role: FOLLOWER
I20260809 22:55:51.274346 26669 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcde561467974661b14bf260c6e05648" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 46703 } }
I20260809 22:55:51.274657 26669 raft_consensus.cc:388] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:51.274813 26669 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:51.274993 26669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:51.277740 26669 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcde561467974661b14bf260c6e05648" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 46703 } }
I20260809 22:55:51.278252 26669 leader_election.cc:302] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcde561467974661b14bf260c6e05648; no voters:
I20260809 22:55:51.278847 26669 leader_election.cc:288] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:51.278981 26685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:51.279805 26685 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [term 1 LEADER]: Becoming Leader. State: Replica: bcde561467974661b14bf260c6e05648, State: Running, Role: LEADER
I20260809 22:55:51.280414 26685 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcde561467974661b14bf260c6e05648" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 46703 } }
I20260809 22:55:51.281123 26669 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:51.283759 26687 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcde561467974661b14bf260c6e05648. Latest consensus state: current_term: 1 leader_uuid: "bcde561467974661b14bf260c6e05648" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcde561467974661b14bf260c6e05648" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 46703 } } }
I20260809 22:55:51.283730 26686 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcde561467974661b14bf260c6e05648" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcde561467974661b14bf260c6e05648" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 46703 } } }
I20260809 22:55:51.284216 26687 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:51.284238 26686 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:51.285120 26693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:51.290241 26693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:51.299809 26693 catalog_manager.cc:1347] Generated new cluster ID: 801e327529ea4cb68d28e2bcbb33926a
I20260809 22:55:51.299924 26693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:51.322597 26693 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:51.323107 26693 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:51.331965 26693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcde561467974661b14bf260c6e05648: Generated new TSK 0
I20260809 22:55:51.332942 26693 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:51.341496 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26570
W20260809 22:55:51.342664 26661 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37437
W20260809 22:55:51.343436 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26570: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:51.343590 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26570
2026-08-09T22:55:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2358 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:51 dist-test-slave-92m1 krb5kdc[26717](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:51 dist-test-slave-92m1 krb5kdc[26717](info): set up 2 sockets
Aug 09 22:55:51 dist-test-slave-92m1 krb5kdc[26717](info): commencing operation
krb5kdc: starting...
W20260809 22:55:52.734360 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.003s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:52 dist-test-slave-92m1 krb5kdc[26717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:53.135293 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:35493
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:43429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:35493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:53.504585 26740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:53.504961 26740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:53.505152 26740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:53.512478 26740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:53.512678 26740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:53.512792 26740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:53.512908 26740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:53.512990 26740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:53.522877 26740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:43429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:35493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:53.524267 26740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:53.525607 26740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:53.538239 26748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:53.538177 26751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:53.538254 26749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:53.539440 26740 server_base.cc:1034] running on GCE node
I20260809 22:55:53.540256 26740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:53.542426 26740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:53.543684 26740 hybrid_clock.cc:648] HybridClock initialized: now 1786316153543566 us; error 100 us; skew 500 ppm
I20260809 22:55:53.544143 26740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:53 dist-test-slave-92m1 krb5kdc[26717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316153, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:53.552825 26740 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:53.554450 26740 webserver.cc:460] Webserver started at http://127.23.131.126:35565/ using document root <none> and password file <none>
I20260809 22:55:53.555195 26740 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:53.555410 26740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:53.555747 26740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:53.558892 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "6e188f3ce1dc406abf174796cf1ffe88"
format_stamp: "Formatted at 2026-08-09 22:55:53 on dist-test-slave-92m1"
server_key: "09def45ea342d45de76ee564dde247f2"
server_key_iv: "6b9c3e3f563683f3692dcf060aebd286"
server_key_version: "encryptionkey@0"
I20260809 22:55:53.559738 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "6e188f3ce1dc406abf174796cf1ffe88"
format_stamp: "Formatted at 2026-08-09 22:55:53 on dist-test-slave-92m1"
server_key: "09def45ea342d45de76ee564dde247f2"
server_key_iv: "6b9c3e3f563683f3692dcf060aebd286"
server_key_version: "encryptionkey@0"
I20260809 22:55:53.565161 26740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 22:55:53.568841 26762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:53.570251 26740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 22:55:53.570462 26740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "6e188f3ce1dc406abf174796cf1ffe88"
format_stamp: "Formatted at 2026-08-09 22:55:53 on dist-test-slave-92m1"
server_key: "09def45ea342d45de76ee564dde247f2"
server_key_iv: "6b9c3e3f563683f3692dcf060aebd286"
server_key_version: "encryptionkey@0"
I20260809 22:55:53.570686 26740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:53.599006 26740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:53.603477 26740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:53.603813 26740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:53.624567 26740 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:35493
I20260809 22:55:53.624598 26838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:35493 every 8 connection(s)
I20260809 22:55:53.626040 26740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:53.627871 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26740
I20260809 22:55:53.628087 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:53.628545 24077 external_mini_cluster.cc:1428] Setting key 23f4de748968fe77cd44cf4ef7c86dd8
I20260809 22:55:53.630472 26840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 22:55:53 dist-test-slave-92m1 krb5kdc[26717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:55:53.644733 26840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88: Bootstrap starting.
I20260809 22:55:53.648941 26840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:53.650254 26840 log.cc:824] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:53.653491 26840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88: No bootstrap required, opened a new log
I20260809 22:55:53.654057 26844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:53.630434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33813 (local address 127.23.131.126:35493)
0809 22:55:53.631391 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:53.631407 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:53.631460 (+ 53us) server_negotiation.cc:407] Connection header received
0809 22:55:53.633717 (+ 2257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:53.633746 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:53.634290 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:53.634789 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:53.636329 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:53.638472 (+ 2143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:53.639868 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:53.640931 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:53.641128 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:53.645613 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:53.645623 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:53.645640 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:53.645684 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:53.649687 (+ 4003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:53.650390 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:53.650399 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:53.650408 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:53.650620 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:53.651065 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:53.651070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:53.651072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:53.651714 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:53.652055 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:53.652514 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 22:55:53.652992 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":376,"threads_started":1}
I20260809 22:55:53.658706 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:53.662912 26840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e188f3ce1dc406abf174796cf1ffe88" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35493 } }
I20260809 22:55:53.663477 26840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:53.663617 26840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e188f3ce1dc406abf174796cf1ffe88, State: Initialized, Role: FOLLOWER
I20260809 22:55:53.664441 26840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e188f3ce1dc406abf174796cf1ffe88" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35493 } }
I20260809 22:55:53.664753 26840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:53.664913 26840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:53.665105 26840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:53.668399 26840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e188f3ce1dc406abf174796cf1ffe88" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35493 } }
I20260809 22:55:53.669080 26840 leader_election.cc:302] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e188f3ce1dc406abf174796cf1ffe88; no voters:
I20260809 22:55:53.670015 26840 leader_election.cc:288] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:53.670137 26851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:53.671926 26851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [term 1 LEADER]: Becoming Leader. State: Replica: 6e188f3ce1dc406abf174796cf1ffe88, State: Running, Role: LEADER
I20260809 22:55:53.672592 26851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e188f3ce1dc406abf174796cf1ffe88" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35493 } }
I20260809 22:55:53.672768 26840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:53.679018 26852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e188f3ce1dc406abf174796cf1ffe88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e188f3ce1dc406abf174796cf1ffe88" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35493 } } }
I20260809 22:55:53.679593 26852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:53.680413 26853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e188f3ce1dc406abf174796cf1ffe88. Latest consensus state: current_term: 1 leader_uuid: "6e188f3ce1dc406abf174796cf1ffe88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e188f3ce1dc406abf174796cf1ffe88" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 35493 } } }
I20260809 22:55:53.680862 26853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:53.684019 26844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:53.663540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47081 (local address 127.23.131.126:35493)
0809 22:55:53.663865 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:53.663873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:53.664187 (+ 314us) server_negotiation.cc:407] Connection header received
0809 22:55:53.664383 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:53.664386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:53.664455 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:53.664538 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:53.666601 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:53.667452 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:53.669459 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:53.670056 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:53.671032 (+ 976us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:53.673412 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:53.673418 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:53.673430 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:55:53.673464 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:53.676904 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:53.677871 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:53.677876 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:53.677880 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:53.678135 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:55:53.678638 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:55:53.678645 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:55:53.678651 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:55:53.679059 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:53.679399 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:53.683471 (+ 4072us) server_negotiation.cc:299] Negotiation successful
0809 22:55:53.683730 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260809 22:55:53.684027 26858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:53.689726 26858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:53.699015 26858 catalog_manager.cc:1347] Generated new cluster ID: 0e700e22cc924c8e859651b7848f0e04
I20260809 22:55:53.699261 26858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:53.721566 26858 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:53.723598 26858 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:53.738538 26858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e188f3ce1dc406abf174796cf1ffe88: Generated new TSK 0
I20260809 22:55:53.739573 26858 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:53.750850 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26740
I20260809 22:55:53.752030 26831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:55:53.847635 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26740
2026-08-09T22:55:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2502 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:53 dist-test-slave-92m1 krb5kdc[26884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:53 dist-test-slave-92m1 krb5kdc[26884](info): set up 2 sockets
Aug 09 22:55:53 dist-test-slave-92m1 krb5kdc[26884](info): commencing operation
krb5kdc: starting...
W20260809 22:55:55.254582 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.361s user 0.000s sys 0.067s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:55 dist-test-slave-92m1 krb5kdc[26884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:55.656713 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:33363
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:40685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:56.020603 26906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:56.020915 26906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:56.021042 26906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:56.028373 26906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:56.028484 26906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:56.028611 26906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:56.028723 26906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:56.028808 26906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:56.038841 26906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:40685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:56.040233 26906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:56.041589 26906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:56.054044 26914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:56.054080 26920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:56.054136 26915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:56.055774 26906 server_base.cc:1034] running on GCE node
I20260809 22:55:56.056581 26906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:56.058092 26906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:56.059340 26906 hybrid_clock.cc:648] HybridClock initialized: now 1786316156059307 us; error 62 us; skew 500 ppm
I20260809 22:55:56.059715 26906 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:56 dist-test-slave-92m1 krb5kdc[26884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316156, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:56.063251 26906 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:56.064812 26906 webserver.cc:460] Webserver started at http://127.23.131.126:42971/ using document root <none> and password file <none>
I20260809 22:55:56.065641 26906 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:56.065799 26906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:56.066148 26906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:56.069419 26906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "c84438a42f3144f8a8f284361a08bb19"
format_stamp: "Formatted at 2026-08-09 22:55:56 on dist-test-slave-92m1"
server_key: "8b6980cdb4919957a3b86fb88c287411"
server_key_iv: "c9a9aab64b67fbeb75404a0c6b6e35c2"
server_key_version: "encryptionkey@0"
I20260809 22:55:56.070283 26906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "c84438a42f3144f8a8f284361a08bb19"
format_stamp: "Formatted at 2026-08-09 22:55:56 on dist-test-slave-92m1"
server_key: "8b6980cdb4919957a3b86fb88c287411"
server_key_iv: "c9a9aab64b67fbeb75404a0c6b6e35c2"
server_key_version: "encryptionkey@0"
I20260809 22:55:56.076004 26906 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 22:55:56.079965 26929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:56.081409 26906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 22:55:56.081630 26906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "c84438a42f3144f8a8f284361a08bb19"
format_stamp: "Formatted at 2026-08-09 22:55:56 on dist-test-slave-92m1"
server_key: "8b6980cdb4919957a3b86fb88c287411"
server_key_iv: "c9a9aab64b67fbeb75404a0c6b6e35c2"
server_key_version: "encryptionkey@0"
I20260809 22:55:56.081856 26906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:56.118480 26906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:56.123270 26906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:56.123605 26906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:56.143518 26906 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:33363
I20260809 22:55:56.143527 27019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:33363 every 8 connection(s)
I20260809 22:55:56.144941 26906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:56.146917 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 26906
I20260809 22:55:56.147126 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:56.147655 24077 external_mini_cluster.cc:1428] Setting key a143aae79ebbb37d89924592a6025e3b
I20260809 22:55:56.149392 27020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:56.162722 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:56.149555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50301 (local address 127.23.131.126:33363)
0809 22:55:56.150389 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:56.150407 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:56.150456 (+ 49us) server_negotiation.cc:407] Connection header received
0809 22:55:56.152641 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:56.152685 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:56.153196 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:56.153639 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:56.154153 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:56.156169 (+ 2016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:56.157416 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:56.158451 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:56.158670 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:56.159908 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:56.159918 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:56.159935 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:56.160684 (+ 749us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:56.160788 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:56.160825 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:56.160944 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:56.161144 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 22:55:56.161416 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":338,"threads_started":1}
I20260809 22:55:56.164318 27020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19: Bootstrap starting.
I20260809 22:55:56.166392 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:56.167856 27020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:56.169188 27020 log.cc:824] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:56.173182 27020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19: No bootstrap required, opened a new log
I20260809 22:55:56.179177 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:56.172420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43009 (local address 127.23.131.126:33363)
0809 22:55:56.172629 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:56.172636 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:56.173034 (+ 398us) server_negotiation.cc:407] Connection header received
0809 22:55:56.173188 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:56.173195 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:56.173276 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:56.173379 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:56.173917 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:56.175048 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:56.176400 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:55:56.177111 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:55:56.177247 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:55:56.178341 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:56.178347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:56.178352 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:56.178372 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:56.178426 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:56.178451 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:56.178551 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:56.178682 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 22:55:56.178779 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 22:55:56.182473 27020 raft_consensus.cc:348] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84438a42f3144f8a8f284361a08bb19" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33363 } }
I20260809 22:55:56.182809 27020 raft_consensus.cc:374] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:56.182883 27020 raft_consensus.cc:729] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84438a42f3144f8a8f284361a08bb19, State: Initialized, Role: FOLLOWER
I20260809 22:55:56.183442 27020 consensus_queue.cc:260] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84438a42f3144f8a8f284361a08bb19" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33363 } }
I20260809 22:55:56.183657 27020 raft_consensus.cc:388] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:56.183759 27020 raft_consensus.cc:482] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:56.183884 27020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:56.186055 27020 raft_consensus.cc:504] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84438a42f3144f8a8f284361a08bb19" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33363 } }
I20260809 22:55:56.186641 27020 leader_election.cc:302] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c84438a42f3144f8a8f284361a08bb19; no voters:
I20260809 22:55:56.187371 27020 leader_election.cc:288] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:56.187482 27037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:56.188261 27037 raft_consensus.cc:686] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [term 1 LEADER]: Becoming Leader. State: Replica: c84438a42f3144f8a8f284361a08bb19, State: Running, Role: LEADER
I20260809 22:55:56.188817 27037 consensus_queue.cc:237] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84438a42f3144f8a8f284361a08bb19" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33363 } }
I20260809 22:55:56.189571 27020 sys_catalog.cc:564] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:56.192027 27039 sys_catalog.cc:455] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c84438a42f3144f8a8f284361a08bb19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84438a42f3144f8a8f284361a08bb19" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33363 } } }
I20260809 22:55:56.192517 27039 sys_catalog.cc:458] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:56.192510 27040 sys_catalog.cc:455] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c84438a42f3144f8a8f284361a08bb19. Latest consensus state: current_term: 1 leader_uuid: "c84438a42f3144f8a8f284361a08bb19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84438a42f3144f8a8f284361a08bb19" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 33363 } } }
I20260809 22:55:56.192905 27040 sys_catalog.cc:458] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:56.194474 27045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:56.200142 27045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:56.210753 27045 catalog_manager.cc:1347] Generated new cluster ID: 1956311228f54b6db84fb34029132519
I20260809 22:55:56.210882 27045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:56.236678 27045 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:56.238044 27045 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:56.246811 27045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c84438a42f3144f8a8f284361a08bb19: Generated new TSK 0
I20260809 22:55:56.247777 27045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:56.258777 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26906
W20260809 22:55:56.259893 27014 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50301
W20260809 22:55:56.260656 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 26906: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:56.260809 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 26906
2026-08-09T22:55:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:56 dist-test-slave-92m1 krb5kdc[27066](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:56 dist-test-slave-92m1 krb5kdc[27066](info): set up 2 sockets
Aug 09 22:55:56 dist-test-slave-92m1 krb5kdc[27066](info): commencing operation
krb5kdc: starting...
W20260809 22:55:57.673925 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.367s user 0.004s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:55:57 dist-test-slave-92m1 krb5kdc[27066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316157, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:55:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:55:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:55:58.088548 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:34453
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:35463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:34453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:55:58.454169 27083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:55:58.454545 27083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:55:58.454725 27083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:55:58.462189 27083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:55:58.462371 27083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:55:58.462488 27083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:55:58.462616 27083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:55:58.462702 27083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:55:58.473093 27083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:35463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:34453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:34453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:55:58.474514 27083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:55:58.475973 27083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:55:58.488576 27093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:58.488493 27099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:55:58.488543 27097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:55:58.489794 27083 server_base.cc:1034] running on GCE node
I20260809 22:55:58.490700 27083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:55:58.492312 27083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:55:58.493527 27083 hybrid_clock.cc:648] HybridClock initialized: now 1786316158493492 us; error 38 us; skew 500 ppm
I20260809 22:55:58.493942 27083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:55:58 dist-test-slave-92m1 krb5kdc[27066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316158, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:55:58.497256 27083 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:55:58.498874 27083 webserver.cc:460] Webserver started at http://127.23.131.126:34857/ using document root <none> and password file <none>
I20260809 22:55:58.499693 27083 fs_manager.cc:359] Metadata directory not provided
I20260809 22:55:58.499856 27083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:55:58.500198 27083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:55:58.503506 27083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "eeb5af9b25134b83b5be2343e2f094f1"
format_stamp: "Formatted at 2026-08-09 22:55:58 on dist-test-slave-92m1"
server_key: "a4470da61402a97846f8884248bcffa6"
server_key_iv: "1cf2bfde7914b233f40d1d1f70ae4b4f"
server_key_version: "encryptionkey@0"
I20260809 22:55:58.504343 27083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "eeb5af9b25134b83b5be2343e2f094f1"
format_stamp: "Formatted at 2026-08-09 22:55:58 on dist-test-slave-92m1"
server_key: "a4470da61402a97846f8884248bcffa6"
server_key_iv: "1cf2bfde7914b233f40d1d1f70ae4b4f"
server_key_version: "encryptionkey@0"
I20260809 22:55:58.509825 27083 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:55:58.513438 27108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:55:58.514777 27083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:55:58.514972 27083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "eeb5af9b25134b83b5be2343e2f094f1"
format_stamp: "Formatted at 2026-08-09 22:55:58 on dist-test-slave-92m1"
server_key: "a4470da61402a97846f8884248bcffa6"
server_key_iv: "1cf2bfde7914b233f40d1d1f70ae4b4f"
server_key_version: "encryptionkey@0"
I20260809 22:55:58.515208 27083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:55:58.521142 27083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:55:58.525236 27083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:55:58.525550 27083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:55:58.544453 27083 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:34453
I20260809 22:55:58.544484 27193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:34453 every 8 connection(s)
I20260809 22:55:58.545984 27083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:55:58.549365 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27083
I20260809 22:55:58.549556 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:55:58.550153 24077 external_mini_cluster.cc:1428] Setting key 8e6d278c3e2883526cd2a2686296d58c
I20260809 22:55:58.550285 27195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:55:58.562799 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:58.552055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40715 (local address 127.23.131.126:34453)
0809 22:55:58.552965 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:58.552977 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:58.553024 (+ 47us) server_negotiation.cc:407] Connection header received
0809 22:55:58.555025 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:58.555046 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:58.555483 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:58.555823 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:58.561139 (+ 5316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:58.561148 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:58.561162 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:58.561180 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:58.561253 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:58.561278 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:58.561466 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:58.561572 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 22:55:58.561809 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":386,"threads_started":1}
I20260809 22:55:58.563643 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1: Bootstrap starting.
I20260809 22:55:58.566946 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:55:58.567601 27195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1: Neither blocks nor log segments found. Creating new log.
I20260809 22:55:58.568892 27195 log.cc:824] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1: Log is configured to *not* fsync() on all Append() calls
I20260809 22:55:58.572412 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1: No bootstrap required, opened a new log
I20260809 22:55:58.575114 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:55:58.572663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34229 (local address 127.23.131.126:34453)
0809 22:55:58.572861 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 22:55:58.572868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:55:58.573029 (+ 161us) server_negotiation.cc:407] Connection header received
0809 22:55:58.573245 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:55:58.573250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:55:58.573310 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:55:58.573425 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:55:58.574408 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:55:58.574413 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:55:58.574418 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 22:55:58.574436 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:55:58.574488 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 22:55:58.574503 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:55:58.574647 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 22:55:58.574740 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 22:55:58.574808 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:55:58.581254 27195 raft_consensus.cc:348] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeb5af9b25134b83b5be2343e2f094f1" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34453 } }
I20260809 22:55:58.581699 27195 raft_consensus.cc:374] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 22:55:58.581815 27195 raft_consensus.cc:729] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb5af9b25134b83b5be2343e2f094f1, State: Initialized, Role: FOLLOWER
I20260809 22:55:58.582551 27195 consensus_queue.cc:260] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeb5af9b25134b83b5be2343e2f094f1" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34453 } }
I20260809 22:55:58.582862 27195 raft_consensus.cc:388] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 22:55:58.583039 27195 raft_consensus.cc:482] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 22:55:58.583266 27195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:55:58.585600 27195 raft_consensus.cc:504] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeb5af9b25134b83b5be2343e2f094f1" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34453 } }
I20260809 22:55:58.586090 27195 leader_election.cc:302] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eeb5af9b25134b83b5be2343e2f094f1; no voters:
I20260809 22:55:58.586777 27195 leader_election.cc:288] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 22:55:58.586939 27210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:55:58.588347 27210 raft_consensus.cc:686] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [term 1 LEADER]: Becoming Leader. State: Replica: eeb5af9b25134b83b5be2343e2f094f1, State: Running, Role: LEADER
I20260809 22:55:58.589030 27210 consensus_queue.cc:237] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeb5af9b25134b83b5be2343e2f094f1" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34453 } }
I20260809 22:55:58.589246 27195 sys_catalog.cc:564] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:55:58.592198 27213 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eeb5af9b25134b83b5be2343e2f094f1. Latest consensus state: current_term: 1 leader_uuid: "eeb5af9b25134b83b5be2343e2f094f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeb5af9b25134b83b5be2343e2f094f1" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34453 } } }
I20260809 22:55:58.592726 27213 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:58.592250 27212 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eeb5af9b25134b83b5be2343e2f094f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeb5af9b25134b83b5be2343e2f094f1" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 34453 } } }
I20260809 22:55:58.593155 27212 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1 [sys.catalog]: This master's current role is: LEADER
I20260809 22:55:58.594580 27221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:55:58.600729 27221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 22:55:58.610095 27221 catalog_manager.cc:1347] Generated new cluster ID: 036fa6c23e954179870d3238ba5e337e
I20260809 22:55:58.610232 27221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:55:58.633988 27221 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:55:58.634488 27221 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:55:58.649116 27221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eeb5af9b25134b83b5be2343e2f094f1: Generated new TSK 0
I20260809 22:55:58.650199 27221 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:55:58.665851 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27083
W20260809 22:55:58.666998 27189 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40715
W20260809 22:55:58.667757 24077 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27083: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 22:55:58.667932 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27083
2026-08-09T22:55:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2409 ms)
[----------] 18 tests from AuthTokenIssuingTest (43714 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:55:58 dist-test-slave-92m1 krb5kdc[27248](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:55:58 dist-test-slave-92m1 krb5kdc[27248](info): set up 2 sockets
Aug 09 22:55:58 dist-test-slave-92m1 krb5kdc[27248](info): commencing operation
krb5kdc: starting...
W20260809 22:56:00.062928 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.000s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:56:00 dist-test-slave-92m1 krb5kdc[27248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:56:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:56:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:56:00.474988 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44543
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44543,127.23.131.125:39771,127.23.131.124:42891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:56:00.843144 27264 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 22:56:00.843631 27264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:56:00.843743 27264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:56:00.843895 27264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:56:00.851552 27264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:56:00.851670 27264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:56:00.851787 27264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:56:00.851882 27264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:56:00.851979 27264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:56:00.862691 27264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44543,127.23.131.125:39771,127.23.131.124:42891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:44543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:56:00.864246 27264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:56:00.865748 27264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:56:00.878365 27276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:00.878261 27281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:00.878309 27277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:56:00.879599 27264 server_base.cc:1034] running on GCE node
I20260809 22:56:00.880621 27264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:56:00.882166 27264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:56:00.883422 27264 hybrid_clock.cc:648] HybridClock initialized: now 1786316160883354 us; error 46 us; skew 500 ppm
I20260809 22:56:00.883777 27264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:56:00 dist-test-slave-92m1 krb5kdc[27248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:56:00.887056 27264 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:56:00.888624 27264 webserver.cc:460] Webserver started at http://127.23.131.126:41675/ using document root <none> and password file <none>
I20260809 22:56:00.889366 27264 fs_manager.cc:359] Metadata directory not provided
I20260809 22:56:00.889500 27264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:56:00.889840 27264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:56:00.893011 27264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "ec52219fd2aa460a957b765fd7d453bb"
format_stamp: "Formatted at 2026-08-09 22:56:00 on dist-test-slave-92m1"
server_key: "ab7624f6857c586fc67ac717e2235ae5"
server_key_iv: "591f5d292cb8c983ebfeb6dcbf2f78fd"
server_key_version: "encryptionkey@0"
I20260809 22:56:00.893844 27264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "ec52219fd2aa460a957b765fd7d453bb"
format_stamp: "Formatted at 2026-08-09 22:56:00 on dist-test-slave-92m1"
server_key: "ab7624f6857c586fc67ac717e2235ae5"
server_key_iv: "591f5d292cb8c983ebfeb6dcbf2f78fd"
server_key_version: "encryptionkey@0"
I20260809 22:56:00.899170 27264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 22:56:00.902844 27292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:56:00.904361 27264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:56:00.904563 27264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "ec52219fd2aa460a957b765fd7d453bb"
format_stamp: "Formatted at 2026-08-09 22:56:00 on dist-test-slave-92m1"
server_key: "ab7624f6857c586fc67ac717e2235ae5"
server_key_iv: "591f5d292cb8c983ebfeb6dcbf2f78fd"
server_key_version: "encryptionkey@0"
I20260809 22:56:00.904803 27264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:56:00.918566 27264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:56:00.922734 27264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:56:00.923027 27264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:56:00.943078 27264 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:44543
I20260809 22:56:00.943099 27386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:44543 every 8 connection(s)
I20260809 22:56:00.944617 27264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:56:00.945461 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27264
I20260809 22:56:00.945729 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:56:00.946530 24077 external_mini_cluster.cc:1428] Setting key 815c0edcaf567245ec50ed3dc80970cf
I20260809 22:56:00.948894 27387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:56:00.955974 27387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:00 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:00.983312 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:00.959053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44543 (local address 127.0.0.1:47544)
0809 22:56:00.960033 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:00.960108 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:00.963165 (+ 3057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:00.964121 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:00.964131 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:00.965015 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:00.965468 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:00.965487 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:00.968040 (+ 2553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:00.968044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:00.969194 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:00.969208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:00.970660 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:00.970665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:00.970835 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:00.971665 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:00.971694 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:00.974301 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:00.979043 (+ 4742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:00.979054 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:00.979065 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:00.979558 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:00.980066 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:00.980069 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:00.980072 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:00.980228 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:00.981269 (+ 1041us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:00.981274 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:00.981461 (+ 187us) client_negotiation.cc:769] Sending connection context
0809 22:56:00.981676 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 22:56:00.982093 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":413,"threads_started":1}
I20260809 22:56:00.983366 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:00.960359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.23.131.126:44543)
0809 22:56:00.962041 (+ 1682us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:00.962049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:00.962095 (+ 46us) server_negotiation.cc:407] Connection header received
0809 22:56:00.963606 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:00.963612 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:00.963861 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:00.964042 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:00.965732 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:00.967826 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:00.969375 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:00.970416 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:00.970643 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:00.974603 (+ 3960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:00.974616 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:00.974638 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:00.974689 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:00.978866 (+ 4177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:00.979707 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:00.979721 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:00.979727 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:00.979943 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:00.980346 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:00.980353 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:00.980359 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:00.981128 (+ 769us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:00.981347 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:00.981878 (+ 531us) server_negotiation.cc:299] Negotiation successful
0809 22:56:00.982302 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":1505,"thread_start_us":1327,"threads_started":1}
I20260809 22:56:00.986853 27387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:56:00.988000 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:00.987631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44476)
0809 22:56:00.987788 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:00.987895 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 22:56:00.988236 27296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.23.131.125@KRBTEST.COM; defaulting to no policy
I20260809 22:56:00.989830 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:00.989460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44488)
0809 22:56:00.989629 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:00.989707 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 22:56:00.990010 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:39771: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab.
Entry for principal kudu/127.23.131.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab.
I20260809 22:56:01.038978 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:39771
--webserver_interface=127.23.131.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab
--principal=kudu/127.23.131.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44543,127.23.131.125:39771,127.23.131.124:42891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:56:01.039398 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } attempt: 1
I20260809 22:56:01.040562 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.040087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44496)
0809 22:56:01.040304 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.040415 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 22:56:01.041563 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.041205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44500)
0809 22:56:01.041359 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.041432 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:56:01.041792 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:39771: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
I20260809 22:56:01.110023 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } attempt: 2
I20260809 22:56:01.111413 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.110818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44514)
0809 22:56:01.111074 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.111184 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 22:56:01.112483 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.112086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44528)
0809 22:56:01.112258 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.112344 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 22:56:01.112717 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:39771: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
I20260809 22:56:01.203969 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } attempt: 3
I20260809 22:56:01.205155 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.204696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44530)
0809 22:56:01.204912 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.205013 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 22:56:01.206457 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.205857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44534)
0809 22:56:01.206100 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.206228 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 22:56:01.206745 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:39771: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
I20260809 22:56:01.350019 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } attempt: 4
I20260809 22:56:01.351290 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.350695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44540)
0809 22:56:01.351007 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.351100 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260809 22:56:01.352270 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.351923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44546)
0809 22:56:01.352061 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.352152 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 22:56:01.352455 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:39771: Network error: Client connection negotiation failed: client connection to 127.23.131.125:39771: connect: Connection refused (error 111)
W20260809 22:56:01.408463 27397 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 22:56:01.408879 27397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:56:01.408990 27397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:56:01.409122 27397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:56:01.416733 27397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:56:01.416817 27397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:56:01.416950 27397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:56:01.417027 27397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:56:01.417120 27397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:56:01.427295 27397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44543,127.23.131.125:39771,127.23.131.124:42891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab
--principal=kudu/127.23.131.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:39771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.131.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:56:01.428761 27397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:56:01.430133 27397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:56:01.442446 27407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:01.442507 27403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:01.442528 27402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:56:01.443374 27397 server_base.cc:1034] running on GCE node
I20260809 22:56:01.444271 27397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:56:01.445797 27397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:56:01.447081 27397 hybrid_clock.cc:648] HybridClock initialized: now 1786316161447005 us; error 44 us; skew 500 ppm
I20260809 22:56:01.447544 27397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:56:01 dist-test-slave-92m1 krb5kdc[27248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316161, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:56:01.451263 27397 init.cc:377] Logged in from keytab as kudu/127.23.131.125@KRBTEST.COM (short username kudu)
I20260809 22:56:01.452863 27397 webserver.cc:460] Webserver started at http://127.23.131.125:37751/ using document root <none> and password file <none>
I20260809 22:56:01.453693 27397 fs_manager.cc:359] Metadata directory not provided
I20260809 22:56:01.453827 27397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:56:01.454162 27397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:56:01.457351 27397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data/instance:
uuid: "de8d7ea177e14cc4a9def4d5d7467be2"
format_stamp: "Formatted at 2026-08-09 22:56:01 on dist-test-slave-92m1"
server_key: "6cd0ab6a545a6d81e509a17316e650bf"
server_key_iv: "9d7a0f3d3be6e3d1fcd46a193346cf9e"
server_key_version: "encryptionkey@0"
I20260809 22:56:01.458195 27397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal/instance:
uuid: "de8d7ea177e14cc4a9def4d5d7467be2"
format_stamp: "Formatted at 2026-08-09 22:56:01 on dist-test-slave-92m1"
server_key: "6cd0ab6a545a6d81e509a17316e650bf"
server_key_iv: "9d7a0f3d3be6e3d1fcd46a193346cf9e"
server_key_version: "encryptionkey@0"
I20260809 22:56:01.463999 27397 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 22:56:01.467638 27420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:56:01.468936 27397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 22:56:01.469117 27397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal
uuid: "de8d7ea177e14cc4a9def4d5d7467be2"
format_stamp: "Formatted at 2026-08-09 22:56:01 on dist-test-slave-92m1"
server_key: "6cd0ab6a545a6d81e509a17316e650bf"
server_key_iv: "9d7a0f3d3be6e3d1fcd46a193346cf9e"
server_key_version: "encryptionkey@0"
I20260809 22:56:01.469349 27397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:56:01.484701 27397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:56:01.488996 27397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:56:01.489288 27397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:56:01.508817 27397 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.125:39771
I20260809 22:56:01.508939 27502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.125:39771 every 8 connection(s)
I20260809 22:56:01.510303 27397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
I20260809 22:56:01.514098 27503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:56:01.520301 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27397
I20260809 22:56:01.520530 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-1/wal/instance
I20260809 22:56:01.521071 24077 external_mini_cluster.cc:1428] Setting key 46fa81407e7047abcf238b593ccc7a95
I20260809 22:56:01.521201 27503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:01 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316161, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:01.548954 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.524708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.23.131.126:44543)
0809 22:56:01.525332 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:01.525339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:01.526292 (+ 953us) server_negotiation.cc:407] Connection header received
0809 22:56:01.529269 (+ 2977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:01.529274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:01.529354 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:01.529444 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:01.531680 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.532489 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.534956 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.535449 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.535557 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:01.540344 (+ 4787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:01.540350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:01.540354 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:01.540416 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:01.544747 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:01.545889 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:01.545899 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:01.545905 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:01.546129 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:01.546722 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:01.546731 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:01.546737 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:01.547314 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:01.547489 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:01.548299 (+ 810us) server_negotiation.cc:299] Negotiation successful
0809 22:56:01.548536 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":333,"threads_started":1}
I20260809 22:56:01.550065 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.525193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44543 (local address 127.0.0.1:47554)
0809 22:56:01.526106 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.526158 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:01.528925 (+ 2767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:01.529736 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:01.529749 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:01.530575 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:01.531454 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:01.531483 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.532674 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.532682 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:01.534769 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:01.534788 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.535697 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.535707 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:01.536070 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:01.536864 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:01.536901 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:01.540046 (+ 3145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:01.544981 (+ 4935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:01.544992 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:01.545013 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:01.545720 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:01.546265 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:01.546270 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:01.546274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:01.546539 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:01.547481 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:01.547490 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:01.547916 (+ 426us) client_negotiation.cc:769] Sending connection context
0809 22:56:01.548195 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 22:56:01.548759 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":357,"threads_started":1}
I20260809 22:56:01.552335 27503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:01 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316161, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.131.124@KRBTEST.COM; defaulting to no policy
I20260809 22:56:01.567680 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.553208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44552)
0809 22:56:01.553454 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.553471 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:01.553566 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:01.554684 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:01.554688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:01.555165 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:01.555357 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:01.555365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.556745 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.556752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:01.557600 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:01.557611 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.558458 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.558463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:01.558684 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:01.559371 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:01.559389 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:01.561555 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:01.564959 (+ 3404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:01.564964 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:01.564969 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:01.565385 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:01.565786 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:01.565791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:01.565794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:01.565923 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:01.566604 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:01.566608 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:01.566757 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 22:56:01.566896 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 22:56:01.567195 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":3}
I20260809 22:56:01.567728 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.553515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44552 (local address 127.23.131.125:39771)
0809 22:56:01.554279 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:01.554285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:01.554309 (+ 24us) server_negotiation.cc:407] Connection header received
0809 22:56:01.554351 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:01.554357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:01.554529 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:01.554699 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:01.555530 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.556613 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.557744 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.558311 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.558448 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:01.561765 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:01.561776 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:01.561790 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:01.561819 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:01.564810 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:01.565519 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:01.565532 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:01.565534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:01.565651 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:01.566031 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:01.566044 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:01.566048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:01.566480 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:01.566690 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:01.567043 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 22:56:01.567342 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":612,"thread_start_us":466,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.124@KRBTEST.COM" created.
I20260809 22:56:01.570348 27503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:56:01.571689 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.571055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56508)
0809 22:56:01.571310 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.571475 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260809 22:56:01.571928 27423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.573714 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.573363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56516)
0809 22:56:01.573525 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.573601 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 22:56:01.573927 27503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab.
Entry for principal kudu/127.23.131.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab.
I20260809 22:56:01.612815 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:42891
--webserver_interface=127.23.131.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab
--principal=kudu/127.23.131.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:44543,127.23.131.125:39771,127.23.131.124:42891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:56:01.623309 27503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 1
I20260809 22:56:01.624470 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.624005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56524)
0809 22:56:01.624209 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.624315 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 22:56:01.625483 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.625154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56538)
0809 22:56:01.625309 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.625378 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 22:56:01.625761 27503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.651713 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } attempt: 5
Aug 09 22:56:01 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:56:01.665998 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.652610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44564 (local address 127.23.131.125:39771)
0809 22:56:01.652833 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:01.652840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:01.652866 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:56:01.652972 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:01.652978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:01.653078 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:01.653196 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:01.654189 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.655337 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.656467 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.657165 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.657286 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:01.660708 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:01.660713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:01.660717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:01.660758 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:01.663461 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:01.664244 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:01.664248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:01.664250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:01.664370 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:01.664757 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:01.664760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:01.664762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:01.665051 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:01.665162 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:01.665603 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 22:56:01.665774 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 22:56:01.666291 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.652516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44564)
0809 22:56:01.652728 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.652753 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:01.652861 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:01.653254 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:01.653258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:01.653728 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:01.654022 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:01.654040 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.655459 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.655463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:01.656320 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:01.656332 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:01.657313 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:01.657317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:01.657468 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:01.658113 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:01.658130 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:01.660492 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:01.663612 (+ 3120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:01.663618 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:01.663622 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:01.664132 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:01.664476 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:01.664480 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:01.664484 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:01.664655 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:01.665169 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:01.665174 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:01.665342 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 22:56:01.665500 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 22:56:01.665817 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 22:56:01.667409 27387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:56:01.668605 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.668140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56554)
0809 22:56:01.668334 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.668435 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 22:56:01.669691 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.669301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56558)
0809 22:56:01.669453 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.669554 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 22:56:01.669951 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.694017 27503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 2
I20260809 22:56:01.695397 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.694782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56570)
0809 22:56:01.695018 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.695150 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 22:56:01.696516 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.696124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56574)
0809 22:56:01.696284 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.696371 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:56:01.696743 27503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.721284 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 1
I20260809 22:56:01.722633 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.722138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56580)
0809 22:56:01.722345 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.722442 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 22:56:01.723690 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.723380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56594)
0809 22:56:01.723509 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.723586 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 22:56:01.723913 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.788007 27503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 3
I20260809 22:56:01.789507 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.788802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56596)
0809 22:56:01.789074 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.789252 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 22:56:01.790750 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.790219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56606)
0809 22:56:01.790488 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.790592 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260809 22:56:01.790993 27503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.792145 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 2
I20260809 22:56:01.793196 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.792761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56610)
0809 22:56:01.792961 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.793045 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 22:56:01.794260 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.793950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56612)
0809 22:56:01.794080 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.794147 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 22:56:01.794528 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.900768 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 3
I20260809 22:56:01.902004 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.901533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56614)
0809 22:56:01.901740 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.901834 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 22:56:01.903072 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.902704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56620)
0809 22:56:01.902906 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.902978 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260809 22:56:01.903398 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:01.934247 27503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 4
I20260809 22:56:01.935724 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.935069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56636)
0809 22:56:01.935367 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.935494 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 22:56:01.936749 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:01.936430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56652)
0809 22:56:01.936573 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:01.936644 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 22:56:01.937000 27503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
W20260809 22:56:01.988009 27515 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 22:56:01.988394 27515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:56:01.988515 27515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:56:01.988686 27515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:56:01.996179 27515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:56:01.996276 27515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:56:01.996366 27515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:56:01.996459 27515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:56:01.996568 27515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:56:02.006865 27515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:44543,127.23.131.125:39771,127.23.131.124:42891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab
--principal=kudu/127.23.131.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:42891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.131.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:56:02.008376 27515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:56:02.009814 27515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:56:02.022204 27523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:02.022296 27522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:02.022333 27527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:56:02.023288 27515 server_base.cc:1034] running on GCE node
I20260809 22:56:02.024111 27515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:56:02.025573 27515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:56:02.026839 27515 hybrid_clock.cc:648] HybridClock initialized: now 1786316162026769 us; error 44 us; skew 500 ppm
I20260809 22:56:02.027235 27515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316162, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:56:02.030601 27515 init.cc:377] Logged in from keytab as kudu/127.23.131.124@KRBTEST.COM (short username kudu)
I20260809 22:56:02.032167 27515 webserver.cc:460] Webserver started at http://127.23.131.124:46119/ using document root <none> and password file <none>
I20260809 22:56:02.032920 27515 fs_manager.cc:359] Metadata directory not provided
I20260809 22:56:02.033056 27515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:56:02.033391 27515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:56:02.036576 27515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data/instance:
uuid: "b9e74a55ecb84e639d016631886710b6"
format_stamp: "Formatted at 2026-08-09 22:56:02 on dist-test-slave-92m1"
server_key: "19e096e30b0bc85c12f322a60e3ab403"
server_key_iv: "93e0140930cf34d7b9ab680abfaaeb56"
server_key_version: "encryptionkey@0"
I20260809 22:56:02.037408 27515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal/instance:
uuid: "b9e74a55ecb84e639d016631886710b6"
format_stamp: "Formatted at 2026-08-09 22:56:02 on dist-test-slave-92m1"
server_key: "19e096e30b0bc85c12f322a60e3ab403"
server_key_iv: "93e0140930cf34d7b9ab680abfaaeb56"
server_key_version: "encryptionkey@0"
I20260809 22:56:02.042667 27515 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 22:56:02.046388 27539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:56:02.047806 27515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 22:56:02.047992 27515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal
uuid: "b9e74a55ecb84e639d016631886710b6"
format_stamp: "Formatted at 2026-08-09 22:56:02 on dist-test-slave-92m1"
server_key: "19e096e30b0bc85c12f322a60e3ab403"
server_key_iv: "93e0140930cf34d7b9ab680abfaaeb56"
server_key_version: "encryptionkey@0"
I20260809 22:56:02.048223 27515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:56:02.061774 27515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:56:02.066318 27515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:56:02.066622 27515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:56:02.080610 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 4
I20260809 22:56:02.081754 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.081230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56656)
0809 22:56:02.081417 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.081537 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 22:56:02.083025 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.082512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56672)
0809 22:56:02.082740 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.082848 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 22:56:02.083338 27387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:42891: Network error: Client connection negotiation failed: client connection to 127.23.131.124:42891: connect: Connection refused (error 111)
I20260809 22:56:02.090245 27515 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.124:42891
I20260809 22:56:02.090216 27617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.124:42891 every 8 connection(s)
I20260809 22:56:02.091734 27515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
I20260809 22:56:02.092054 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27515
I20260809 22:56:02.092237 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786315774646092-24077-0/minicluster-data/master-2/wal/instance
I20260809 22:56:02.092746 24077 external_mini_cluster.cc:1428] Setting key 33cabcc92121e27638d9088c24109e29
I20260809 22:56:02.096240 27622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:56:02.104918 27622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316162, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:02.118091 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.094640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56686 (local address 127.23.131.124:42891)
0809 22:56:02.095431 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.095443 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.095483 (+ 40us) server_negotiation.cc:407] Connection header received
0809 22:56:02.097100 (+ 1617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.097119 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.097453 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.097736 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.099636 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.100951 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.102895 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.103706 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.103868 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.109642 (+ 5774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.109652 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.109668 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.109720 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.113613 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.114363 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.114370 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.114376 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.114546 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.114959 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.114963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.114967 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.115763 (+ 796us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.116099 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.116485 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.116924 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":366,"threads_started":1}
I20260809 22:56:02.124936 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.108221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:44543 (local address 127.0.0.1:47568)
0809 22:56:02.109257 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.109314 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:02.109493 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:02.110059 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:02.110067 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:02.110973 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:02.111435 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.111450 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.112623 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.112628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.114132 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.114144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.115059 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.115066 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.115266 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.115877 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:02.115898 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:02.118545 (+ 2647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:02.122334 (+ 3789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.122345 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.122353 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.122920 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.123334 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.123339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.123355 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.123485 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.124101 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:02.124107 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:02.124255 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 22:56:02.124404 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 22:56:02.124664 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":826,"thread_start_us":691,"threads_started":1}
I20260809 22:56:02.125221 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.108313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.23.131.126:44543)
0809 22:56:02.108900 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.108910 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.109728 (+ 818us) server_negotiation.cc:407] Connection header received
0809 22:56:02.109802 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.109806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.109891 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.109973 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.111647 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.112446 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.114287 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.114811 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.114971 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.118724 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.118729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.118732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.118774 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.122200 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.123060 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.123063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.123066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.123184 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.123592 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.123599 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.123605 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.123975 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.124157 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.124574 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.124789 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":321,"threads_started":1}
I20260809 22:56:02.126756 27622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316162, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:56:02.137367 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.121429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47584 (local address 127.23.131.126:44543)
0809 22:56:02.122081 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.122087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.122113 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:56:02.122167 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.122172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.122237 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.122331 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.123872 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.125092 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.126718 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.127274 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.127414 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.131861 (+ 4447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.131865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.131868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.131898 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.134687 (+ 2789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.135351 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.135358 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.135361 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.135494 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.135866 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.135870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.135878 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.136133 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.136403 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.136738 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.136952 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":319,"threads_started":1}
I20260809 22:56:02.139891 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.127494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:39771 (local address 127.0.0.1:44568)
0809 22:56:02.127730 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.127749 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:02.127852 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:02.128166 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:02.128170 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:02.128571 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:02.128705 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.128712 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.129636 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.129643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.130877 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.130889 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.131655 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.131661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.131840 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.132338 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:02.132354 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:02.134249 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:02.137248 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.137253 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.137257 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.137741 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.138166 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.138171 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.138174 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.138350 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.138902 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:02.138907 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:02.139058 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 22:56:02.139204 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 22:56:02.139514 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 22:56:02.139950 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.127638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44568 (local address 127.23.131.125:39771)
0809 22:56:02.127874 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.127880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.127902 (+ 22us) server_negotiation.cc:407] Connection header received
0809 22:56:02.127971 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.127975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.128040 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.128144 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.128851 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.129507 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.131004 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.131498 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.131641 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.134427 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.134432 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.134435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.134465 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.137101 (+ 2636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.137852 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.137857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.137860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.138035 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.138453 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.138456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.138458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.138786 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.138936 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.139331 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.139550 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:56:02.140808 27622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316162, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:56:02.154980 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.141672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56700)
0809 22:56:02.141820 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.141837 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:02.141920 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:02.142202 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:02.142206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:02.142684 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:02.142849 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.142860 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.144075 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.144078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.145154 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.145168 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.146170 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.146175 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.146322 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.146800 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:02.146816 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:02.148916 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:02.152172 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.152179 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.152183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.152753 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.153115 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.153120 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.153124 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.153289 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.153935 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:02.153939 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:02.154104 (+ 165us) client_negotiation.cc:769] Sending connection context
0809 22:56:02.154287 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 22:56:02.154577 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 22:56:02.155297 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.141766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56700 (local address 127.23.131.124:42891)
0809 22:56:02.141924 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.141929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.141947 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:56:02.141997 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.142001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.142064 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.142164 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.142975 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.143939 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.145312 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.145962 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.146099 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.149099 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.149105 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.149109 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.149149 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.152035 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.152858 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.152862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.152864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.153014 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.153416 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.153423 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.153426 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.153808 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.153972 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.154413 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.154806 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":59}
I20260809 22:56:02.156534 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.139416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44578 (local address 127.23.131.125:39771)
0809 22:56:02.140434 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.140440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.140458 (+ 18us) server_negotiation.cc:407] Connection header received
0809 22:56:02.140505 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.140513 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.140582 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.140688 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.142190 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.143170 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.144643 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.145298 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.145387 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.150058 (+ 4671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.150063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.150066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.150095 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.153301 (+ 3206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.154115 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.154121 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.154124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.154282 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.154829 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.154835 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.154837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.155285 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.155529 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.155949 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.156161 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":930,"thread_start_us":1455,"threads_started":1}
I20260809 22:56:02.161125 27622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: Bootstrap starting.
I20260809 22:56:02.161315 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:56:02.164688 27622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: Neither blocks nor log segments found. Creating new log.
I20260809 22:56:02.166000 27622 log.cc:824] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: Log is configured to *not* fsync() on all Append() calls
I20260809 22:56:02.164034 27338 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ec52219fd2aa460a957b765fd7d453bb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47584
I20260809 22:56:02.169220 27622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: No bootstrap required, opened a new log
I20260809 22:56:02.177806 27622 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.178118 27622 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e74a55ecb84e639d016631886710b6, State: Initialized, Role: FOLLOWER
I20260809 22:56:02.178613 27622 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.179602 27633 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.179946 27633 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.180835 27622 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 22:56:02.190425 27656 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:56:02.190593 27656 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:56:02.188303 27515 master_runner.cc:186] Error getting master registration for 127.23.131.126:44543: OK, instance_id { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" instance_seqno: 1786316160937302 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 22:56:02.199524 27515 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 22:56:02.236207 27503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 5
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316161, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
I20260809 22:56:02.252924 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.237079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56702 (local address 127.23.131.124:42891)
0809 22:56:02.237298 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.237305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.237418 (+ 113us) server_negotiation.cc:407] Connection header received
0809 22:56:02.237634 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.237638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.237705 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.237819 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.238805 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.239649 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.241405 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.241931 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.242104 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.245878 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.245883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.245887 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.245919 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.249567 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.250398 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.250403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.250407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.250555 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.251003 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.251009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.251013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.251547 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.251719 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.252280 (+ 561us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.252505 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 22:56:02.252964 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.236987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56702)
0809 22:56:02.237299 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.237341 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:02.237483 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:02.237850 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:02.237854 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:02.238423 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:02.238638 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.238650 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.239775 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.239782 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.241245 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.241259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.242150 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.242156 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.242403 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.243063 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:02.243086 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:02.245684 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:02.249724 (+ 4040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.249731 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.249735 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.250278 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.250677 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.250682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.250686 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.250893 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.251690 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:02.251696 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:02.251952 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 22:56:02.252143 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 22:56:02.252523 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260809 22:56:02.258122 27503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: Bootstrap starting.
I20260809 22:56:02.262203 27503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: Neither blocks nor log segments found. Creating new log.
I20260809 22:56:02.263502 27503 log.cc:824] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: Log is configured to *not* fsync() on all Append() calls
I20260809 22:56:02.266330 27503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: No bootstrap required, opened a new log
I20260809 22:56:02.273897 27503 raft_consensus.cc:348] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.274282 27503 raft_consensus.cc:729] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de8d7ea177e14cc4a9def4d5d7467be2, State: Initialized, Role: FOLLOWER
I20260809 22:56:02.274834 27503 consensus_queue.cc:260] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.276077 27660 sys_catalog.cc:455] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.276521 27660 sys_catalog.cc:458] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.277272 27503 sys_catalog.cc:564] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:56:02.284740 27397 master_runner.cc:186] Error getting master registration for 127.23.131.126:44543: OK, instance_id { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" instance_seqno: 1786316160937302 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260809 22:56:02.296362 27682 catalog_manager.cc:1558] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:56:02.296569 27682 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:56:02.296900 27397 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 22:56:02.318799 27551 tablet.cc:2369] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:56:02.360607 27387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } attempt: 5
Aug 09 22:56:02 dist-test-slave-92m1 krb5kdc[27248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316160, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
I20260809 22:56:02.380604 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.361441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:42891 (local address 127.0.0.1:56706)
0809 22:56:02.361760 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:02.361782 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:02.361909 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:02.362378 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:02.362384 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:02.362952 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:02.363185 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.363200 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.364796 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.364803 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.366343 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:02.366360 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.367483 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.367490 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:02.367705 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.368558 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:02.368601 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:02.371647 (+ 3046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:02.376409 (+ 4762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.376414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.376419 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.377024 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.377503 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:02.377508 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:02.377512 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:02.377774 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:02.378606 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:02.378612 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:02.378842 (+ 230us) client_negotiation.cc:769] Sending connection context
0809 22:56:02.378995 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 22:56:02.380192 (+ 1197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260809 22:56:02.381101 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.361672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56706 (local address 127.23.131.124:42891)
0809 22:56:02.361883 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.361889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.361915 (+ 26us) server_negotiation.cc:407] Connection header received
0809 22:56:02.362093 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.362099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.362207 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.362314 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.363398 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.364606 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.366502 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.367305 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.367441 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.371908 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.371915 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.371920 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.371964 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.376205 (+ 4241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.377179 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.377186 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.377190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.377364 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.377913 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.377918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.377922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.378360 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.378526 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.379362 (+ 836us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.379675 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 22:56:02.387957 27387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb: Bootstrap starting.
I20260809 22:56:02.392310 27387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb: Neither blocks nor log segments found. Creating new log.
I20260809 22:56:02.393762 27387 log.cc:824] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb: Log is configured to *not* fsync() on all Append() calls
I20260809 22:56:02.402590 27387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb: No bootstrap required, opened a new log
I20260809 22:56:02.410771 27387 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.411235 27387 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec52219fd2aa460a957b765fd7d453bb, State: Initialized, Role: FOLLOWER
I20260809 22:56:02.411798 27387 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.418937 27690 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.419395 27690 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.421501 27387 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:56:02.421648 27338 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 22:56:02.421933 27338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:56:02.425598 27338 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
W20260809 22:56:02.426185 27308 tablet.cc:2369] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:56:02.428332 27461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec52219fd2aa460a957b765fd7d453bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "de8d7ea177e14cc4a9def4d5d7467be2"
I20260809 22:56:02.428858 27461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:56:02.432729 27461 raft_consensus.cc:2454] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec52219fd2aa460a957b765fd7d453bb in term 1.
I20260809 22:56:02.433531 27296 leader_election.cc:302] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de8d7ea177e14cc4a9def4d5d7467be2, ec52219fd2aa460a957b765fd7d453bb; no voters:
I20260809 22:56:02.434026 27690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:56:02.435318 27585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec52219fd2aa460a957b765fd7d453bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b9e74a55ecb84e639d016631886710b6"
I20260809 22:56:02.435879 27585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:56:02.439816 27585 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec52219fd2aa460a957b765fd7d453bb in term 1.
I20260809 22:56:02.440510 27338 leader_election.cc:288] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [CANDIDATE]: Term 1 election: Requested vote from peers de8d7ea177e14cc4a9def4d5d7467be2 (127.23.131.125:39771), b9e74a55ecb84e639d016631886710b6 (127.23.131.124:42891)
I20260809 22:56:02.451519 27690 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [term 1 LEADER]: Becoming Leader. State: Replica: ec52219fd2aa460a957b765fd7d453bb, State: Running, Role: LEADER
I20260809 22:56:02.452219 27690 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } }
I20260809 22:56:02.460475 27698 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec52219fd2aa460a957b765fd7d453bb. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.461165 27698 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: This master's current role is: LEADER
I20260809 22:56:02.466060 27712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:56:02.487555 27712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 22:56:02.491973 27430 tablet.cc:2369] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:56:02.526499 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.465372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.23.131.126:44543)
0809 22:56:02.465572 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.465590 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.478760 (+ 13170us) server_negotiation.cc:407] Connection header received
0809 22:56:02.479357 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.479364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.479456 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.479535 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.488149 (+ 8614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.489325 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.498368 (+ 9043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.499127 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.499272 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.509370 (+ 10098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.509379 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.509387 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.509433 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.513437 (+ 4004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.516630 (+ 3193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.516636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.516640 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.516796 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.517719 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.517725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.517729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.518099 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.518338 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.525849 (+ 7511us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.526118 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 22:56:02.529731 27729 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 22:56:02.530049 27585 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [term 1 FOLLOWER]: Refusing update from remote peer ec52219fd2aa460a957b765fd7d453bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:56:02.532033 27461 raft_consensus.cc:1261] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [term 1 FOLLOWER]: Refusing update from remote peer ec52219fd2aa460a957b765fd7d453bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:56:02.532891 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.467062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56716 (local address 127.23.131.124:42891)
0809 22:56:02.467276 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.467283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.482102 (+ 14819us) server_negotiation.cc:407] Connection header received
0809 22:56:02.484206 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.484212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.484333 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.484404 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.492612 (+ 8208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.493708 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.502718 (+ 9010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.503441 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.503544 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.518910 (+ 15366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.518917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.518923 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.518969 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.522550 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.529405 (+ 6855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.529411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.529414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.529576 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.530290 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.530298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.530301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.530730 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.530976 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.531571 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.532474 (+ 903us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 22:56:02.532770 27698 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:56:02.533478 27690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:56:02.544459 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:02.482758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44588 (local address 127.23.131.125:39771)
0809 22:56:02.482971 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.482977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.492311 (+ 9334us) server_negotiation.cc:407] Connection header received
0809 22:56:02.495913 (+ 3602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.495919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.496011 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.496084 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.504515 (+ 8431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.505699 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.515320 (+ 9621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:02.516071 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:02.516176 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:02.535778 (+ 19602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:02.535785 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:02.535791 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:02.535832 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:02.539865 (+ 4033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.541457 (+ 1592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.541464 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.541467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.541693 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:02.542316 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:02.542321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:02.542324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:02.542834 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:02.543149 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:02.543800 (+ 651us) server_negotiation.cc:299] Negotiation successful
0809 22:56:02.544067 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 22:56:02.583134 27633 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec52219fd2aa460a957b765fd7d453bb. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.583580 27633 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.589578 27724 mvcc.cc:205] Tried to move back new op lower bound from 7316751001661251584 to 7316751001410273280. Current Snapshot: MvccSnapshot[applied={T|T < 7316751001661251584}]
I20260809 22:56:02.593055 27730 mvcc.cc:205] Tried to move back new op lower bound from 7316751001661251584 to 7316751001410273280. Current Snapshot: MvccSnapshot[applied={T|T < 7316751001661251584}]
I20260809 22:56:02.598666 27660 sys_catalog.cc:455] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec52219fd2aa460a957b765fd7d453bb. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.598989 27660 sys_catalog.cc:458] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.605304 27690 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.605625 27690 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: This master's current role is: LEADER
I20260809 22:56:02.606045 27690 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.606257 27690 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb [sys.catalog]: This master's current role is: LEADER
I20260809 22:56:02.609804 27731 mvcc.cc:205] Tried to move back new op lower bound from 7316751001661251584 to 7316751001410273280. Current Snapshot: MvccSnapshot[applied={T|T < 7316751001661251584}]
I20260809 22:56:02.616122 27712 catalog_manager.cc:1347] Generated new cluster ID: 7d748291054e42faa1ebb1d8c22ff5f6
I20260809 22:56:02.616242 27712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:56:02.625505 27633 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.625748 27633 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.629990 27660 sys_catalog.cc:455] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ec52219fd2aa460a957b765fd7d453bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec52219fd2aa460a957b765fd7d453bb" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 44543 } } peers { permanent_uuid: "de8d7ea177e14cc4a9def4d5d7467be2" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 39771 } } peers { permanent_uuid: "b9e74a55ecb84e639d016631886710b6" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 42891 } } }
I20260809 22:56:02.630273 27660 sys_catalog.cc:458] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:02.642673 27712 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:56:02.644553 27712 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:56:02.695443 27712 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec52219fd2aa460a957b765fd7d453bb: Generated new TSK 0
I20260809 22:56:02.700829 27712 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 22:56:02.830603 27629 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.821864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47600 (local address 127.23.131.126:44543)
0809 22:56:02.822257 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.822264 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.827961 (+ 5697us) server_negotiation.cc:407] Connection header received
0809 22:56:02.828324 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.828334 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.828462 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.828558 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.830230 (+ 1672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47600: BlockingRecv error: recv got EOF from 127.0.0.1:47600 (error 108)
Metrics: {"server-negotiator.queue_time_us":255}
W20260809 22:56:02.833299 27625 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.822055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56726 (local address 127.23.131.124:42891)
0809 22:56:02.822398 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.822403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.831248 (+ 8845us) server_negotiation.cc:407] Connection header received
0809 22:56:02.831688 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.831694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.831781 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.831857 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.833043 (+ 1186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56726: BlockingRecv error: recv got EOF from 127.0.0.1:56726 (error 108)
Metrics: {"server-negotiator.queue_time_us":228}
W20260809 22:56:02.835808 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.828062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44596 (local address 127.23.131.125:39771)
0809 22:56:02.828259 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.828264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.834167 (+ 5903us) server_negotiation.cc:407] Connection header received
0809 22:56:02.834408 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.834415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.834516 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.834590 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.835586 (+ 996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44596: BlockingRecv error: recv got EOF from 127.0.0.1:44596 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 22:56:02.870851 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.868766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44604 (local address 127.23.131.125:39771)
0809 22:56:02.868965 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.868971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.869298 (+ 327us) server_negotiation.cc:407] Connection header received
0809 22:56:02.869526 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.869532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.869677 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.869813 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.870558 (+ 745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44604: BlockingRecv error: recv got EOF from 127.0.0.1:44604 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 22:56:02.878938 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.876858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.23.131.125:39771)
0809 22:56:02.877052 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.877059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.877258 (+ 199us) server_negotiation.cc:407] Connection header received
0809 22:56:02.877523 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.877528 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.877607 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.877746 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.878678 (+ 932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44620: BlockingRecv error: recv got EOF from 127.0.0.1:44620 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 22:56:02.886871 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.884942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44624 (local address 127.23.131.125:39771)
0809 22:56:02.885163 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.885171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.885478 (+ 307us) server_negotiation.cc:407] Connection header received
0809 22:56:02.885717 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.885722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.885793 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.885893 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.886613 (+ 720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44624: BlockingRecv error: recv got EOF from 127.0.0.1:44624 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 22:56:02.895804 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.893850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44632 (local address 127.23.131.125:39771)
0809 22:56:02.894086 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.894091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.894360 (+ 269us) server_negotiation.cc:407] Connection header received
0809 22:56:02.894539 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.894542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.894643 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.894724 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.895572 (+ 848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44632: BlockingRecv error: recv got EOF from 127.0.0.1:44632 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260809 22:56:02.908954 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.907013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44638 (local address 127.23.131.125:39771)
0809 22:56:02.907216 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.907223 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.907650 (+ 427us) server_negotiation.cc:407] Connection header received
0809 22:56:02.907781 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.907786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.907867 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.907978 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.908730 (+ 752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44638: BlockingRecv error: recv got EOF from 127.0.0.1:44638 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 22:56:02.930775 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.928703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44644 (local address 127.23.131.125:39771)
0809 22:56:02.928922 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.928928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.929234 (+ 306us) server_negotiation.cc:407] Connection header received
0809 22:56:02.929439 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.929443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.929514 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.929612 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.930542 (+ 930us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44644: BlockingRecv error: recv got EOF from 127.0.0.1:44644 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260809 22:56:02.969254 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:02.967097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.23.131.125:39771)
0809 22:56:02.967368 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:02.967377 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:02.967811 (+ 434us) server_negotiation.cc:407] Connection header received
0809 22:56:02.967973 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:02.967978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:02.968088 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:02.968228 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:02.968993 (+ 765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44646: BlockingRecv error: recv got EOF from 127.0.0.1:44646 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260809 22:56:03.039408 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:03.037242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.23.131.125:39771)
0809 22:56:03.037461 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.037467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.037827 (+ 360us) server_negotiation.cc:407] Connection header received
0809 22:56:03.038049 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.038052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.038157 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.038254 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:03.039167 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44648: BlockingRecv error: recv got EOF from 127.0.0.1:44648 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260809 22:56:03.174259 27509 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:03.172195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.23.131.125:39771)
0809 22:56:03.172473 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.172480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.172791 (+ 311us) server_negotiation.cc:407] Connection header received
0809 22:56:03.172944 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.172948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.173102 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.173196 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:03.173958 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44656: BlockingRecv error: recv got EOF from 127.0.0.1:44656 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 22:56:03.192584 27656 catalog_manager.cc:1259] Loaded cluster ID: 7d748291054e42faa1ebb1d8c22ff5f6
I20260809 22:56:03.192708 27656 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: loading cluster ID for follower catalog manager: success
I20260809 22:56:03.195261 27656 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: acquiring CA information for follower catalog manager: success
I20260809 22:56:03.197007 27656 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b9e74a55ecb84e639d016631886710b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 22:56:03.298981 27682 catalog_manager.cc:1259] Loaded cluster ID: 7d748291054e42faa1ebb1d8c22ff5f6
I20260809 22:56:03.299162 27682 catalog_manager.cc:1552] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: loading cluster ID for follower catalog manager: success
I20260809 22:56:03.301910 27682 catalog_manager.cc:1574] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: acquiring CA information for follower catalog manager: success
I20260809 22:56:03.303921 27682 catalog_manager.cc:1602] T 00000000000000000000000000000000 P de8d7ea177e14cc4a9def4d5d7467be2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 22:56:03.441198 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:03.435337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.23.131.125:39771)
0809 22:56:03.435581 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.435588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.435783 (+ 195us) server_negotiation.cc:407] Connection header received
0809 22:56:03.436062 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.436067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.436228 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.436351 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:03.436828 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.437543 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.438939 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.439368 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.439509 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:03.440007 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:03.440542 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:03.440713 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:03.440805 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 22:56:03.440896 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 22:56:03.458434 27858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:03.452580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.23.131.124:42891)
0809 22:56:03.453073 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.453078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.453158 (+ 80us) server_negotiation.cc:407] Connection header received
0809 22:56:03.453338 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.453342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.453506 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.453657 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:03.454136 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.454838 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.456336 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.456721 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.456810 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:03.457386 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:03.457890 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:03.458022 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:03.458124 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 22:56:03.458186 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":278,"threads_started":1}
I20260809 22:56:03.474098 27868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:03.465227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47616 (local address 127.23.131.126:44543)
0809 22:56:03.465775 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.465781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.466337 (+ 556us) server_negotiation.cc:407] Connection header received
0809 22:56:03.466446 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.466450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.466603 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.466783 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:03.467420 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.468198 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.470280 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.470902 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.471031 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:03.471844 (+ 813us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:03.472280 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:03.472390 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:03.473541 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0809 22:56:03.473656 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":287,"threads_started":1}
I20260809 22:56:03.474706 27858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:03.465335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56750 (local address 127.23.131.124:42891)
0809 22:56:03.465512 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.465520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.468271 (+ 2751us) server_negotiation.cc:407] Connection header received
0809 22:56:03.468529 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.468535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.468606 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.468705 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:03.469601 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.470338 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.472398 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.473112 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.473253 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:03.473753 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:03.473884 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:03.473943 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:03.474364 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 22:56:03.474443 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 22:56:03.475122 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:03.466109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44668 (local address 127.23.131.125:39771)
0809 22:56:03.466298 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:03.466302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:03.468329 (+ 2027us) server_negotiation.cc:407] Connection header received
0809 22:56:03.468447 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:03.468453 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:03.468559 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:03.468663 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:03.469471 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.470528 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.472691 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:03.473423 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:03.473548 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:03.474160 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:03.474347 (+ 187us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:03.474444 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:03.474652 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 22:56:03.474737 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:56:03.479485 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27264
I20260809 22:56:03.480693 27373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:56:03.599236 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27264
I20260809 22:56:03.629803 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27397
I20260809 22:56:03.630995 27498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:56:03.743177 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27397
I20260809 22:56:03.775878 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27515
I20260809 22:56:03.777101 27610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:56:03.888955 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27515
2026-08-09T22:56:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5222 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 22:56:04 dist-test-slave-92m1 krb5kdc[27880](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 22:56:04 dist-test-slave-92m1 krb5kdc[27880](info): set up 2 sockets
Aug 09 22:56:04 dist-test-slave-92m1 krb5kdc[27880](info): commencing operation
krb5kdc: starting...
W20260809 22:56:05.293651 24077 mini_kdc.cc:121] Time spent starting KDC: real 1.354s user 0.001s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/test-user.keytab.
Aug 09 22:56:05 dist-test-slave-92m1 krb5kdc[27880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T22:56:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T22:56:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.131.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
Entry for principal kudu/127.23.131.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab.
I20260809 22:56:05.692741 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45427
--webserver_interface=127.23.131.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45427,127.23.131.125:42237,127.23.131.124:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 22:56:06.066465 27900 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 22:56:06.066840 27900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:56:06.066972 27900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:56:06.067127 27900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:56:06.074828 27900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:56:06.074971 27900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:56:06.075091 27900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:56:06.075194 27900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:56:06.075338 27900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:56:06.085877 27900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45427,127.23.131.125:42237,127.23.131.124:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.126.keytab
--principal=kudu/127.23.131.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.126:45427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.131.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:56:06.087311 27900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:56:06.088792 27900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:56:06.101562 27908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:06.101627 27907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:06.101591 27912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:56:06.102550 27900 server_base.cc:1034] running on GCE node
I20260809 22:56:06.103442 27900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:56:06.104880 27900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:56:06.106117 27900 hybrid_clock.cc:648] HybridClock initialized: now 1786316166106045 us; error 36 us; skew 500 ppm
I20260809 22:56:06.106465 27900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:56:06 dist-test-slave-92m1 krb5kdc[27880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:56:06.109858 27900 init.cc:377] Logged in from keytab as kudu/127.23.131.126@KRBTEST.COM (short username kudu)
I20260809 22:56:06.111477 27900 webserver.cc:460] Webserver started at http://127.23.131.126:44003/ using document root <none> and password file <none>
I20260809 22:56:06.112196 27900 fs_manager.cc:359] Metadata directory not provided
I20260809 22:56:06.112288 27900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:56:06.112571 27900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:56:06.115677 27900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data/instance:
uuid: "08b1fbf8a41749c6935de9e8a8e75723"
format_stamp: "Formatted at 2026-08-09 22:56:06 on dist-test-slave-92m1"
server_key: "d393e32ee95caa7214299d8072b56d6b"
server_key_iv: "1d09eff860ac1ae563dbd28c68ce1a5e"
server_key_version: "encryptionkey@0"
I20260809 22:56:06.116449 27900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal/instance:
uuid: "08b1fbf8a41749c6935de9e8a8e75723"
format_stamp: "Formatted at 2026-08-09 22:56:06 on dist-test-slave-92m1"
server_key: "d393e32ee95caa7214299d8072b56d6b"
server_key_iv: "1d09eff860ac1ae563dbd28c68ce1a5e"
server_key_version: "encryptionkey@0"
I20260809 22:56:06.121901 27900 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260809 22:56:06.125577 27924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:56:06.126941 27900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:56:06.127126 27900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal
uuid: "08b1fbf8a41749c6935de9e8a8e75723"
format_stamp: "Formatted at 2026-08-09 22:56:06 on dist-test-slave-92m1"
server_key: "d393e32ee95caa7214299d8072b56d6b"
server_key_iv: "1d09eff860ac1ae563dbd28c68ce1a5e"
server_key_version: "encryptionkey@0"
I20260809 22:56:06.127409 27900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:56:06.145169 27900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:56:06.149536 27900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:56:06.149865 27900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:56:06.170163 27900 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.126:45427
I20260809 22:56:06.170186 28007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.126:45427 every 8 connection(s)
I20260809 22:56:06.171701 27900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/data/info.pb
I20260809 22:56:06.174083 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 27900
I20260809 22:56:06.174320 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-0/wal/instance
I20260809 22:56:06.174919 24077 external_mini_cluster.cc:1428] Setting key f9b9c904c37680583e03b7aa589f4741
I20260809 22:56:06.176751 28008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:56:06.187491 28008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:06 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:06.213209 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.191786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40472 (local address 127.23.131.126:45427)
0809 22:56:06.193581 (+ 1795us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:06.193593 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:06.193644 (+ 51us) server_negotiation.cc:407] Connection header received
0809 22:56:06.195286 (+ 1642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:06.195292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:06.195536 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:06.195740 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:06.197402 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.198664 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.200981 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.201537 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.201683 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.205925 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:06.205934 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:06.205947 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:06.205977 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:06.208947 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.209704 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.209711 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.209713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.209864 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.210278 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.210287 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.210289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.210825 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:06.211047 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:06.211668 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 22:56:06.212018 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1566,"thread_start_us":1343,"threads_started":1}
I20260809 22:56:06.213269 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.191786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45427 (local address 127.0.0.1:40472)
0809 22:56:06.192735 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.192790 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:06.194858 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:06.195769 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:06.195776 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:06.196661 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:06.197161 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.197187 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.198852 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.198861 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.200819 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.200839 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.201801 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.201811 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.202035 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.202814 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:06.202854 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:06.205679 (+ 2825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:06.209094 (+ 3415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.209116 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.209129 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.209549 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.209986 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.209991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.209995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.210163 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.210963 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:06.210976 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:06.211246 (+ 270us) client_negotiation.cc:769] Sending connection context
0809 22:56:06.211518 (+ 272us) client_negotiation.cc:240] Negotiation successful
0809 22:56:06.212279 (+ 761us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":187,"thread_start_us":423,"threads_started":1}
I20260809 22:56:06.216564 28008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.23.131.125@KRBTEST.COM; defaulting to no policy
I20260809 22:56:06.217757 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.217350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56386)
0809 22:56:06.217531 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.217643 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 22:56:06.218104 27926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.125@KRBTEST.COM" created.
I20260809 22:56:06.219846 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.219379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56388)
0809 22:56:06.219538 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.219644 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 22:56:06.220048 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:42237: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab.
Entry for principal kudu/127.23.131.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab.
I20260809 22:56:06.263882 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:42237
--webserver_interface=127.23.131.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab
--principal=kudu/127.23.131.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45427,127.23.131.125:42237,127.23.131.124:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:56:06.269491 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } attempt: 1
I20260809 22:56:06.270952 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.270319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56398)
0809 22:56:06.270573 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.270747 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 22:56:06.272186 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.271709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56400)
0809 22:56:06.271891 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.271993 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 22:56:06.272416 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:42237: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
I20260809 22:56:06.340683 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } attempt: 2
I20260809 22:56:06.341972 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.341481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56402)
0809 22:56:06.341732 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.341832 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 22:56:06.343034 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.342645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56410)
0809 22:56:06.342818 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.342888 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 22:56:06.343248 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:42237: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
I20260809 22:56:06.434494 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } attempt: 3
I20260809 22:56:06.435767 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.435325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56426)
0809 22:56:06.435532 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.435631 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 22:56:06.436781 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.436421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56434)
0809 22:56:06.436567 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.436641 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 22:56:06.436964 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:42237: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
I20260809 22:56:06.580245 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } attempt: 4
I20260809 22:56:06.581637 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.581034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56446)
0809 22:56:06.581382 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.581478 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
I20260809 22:56:06.582683 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.582311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56456)
0809 22:56:06.582467 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.582548 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 22:56:06.582868 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.125:42237: Network error: Client connection negotiation failed: client connection to 127.23.131.125:42237: connect: Connection refused (error 111)
W20260809 22:56:06.639338 28018 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 22:56:06.639717 28018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:56:06.639842 28018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:56:06.639984 28018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:56:06.647367 28018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:56:06.647488 28018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:56:06.647593 28018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:56:06.647691 28018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:56:06.647781 28018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:56:06.657774 28018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45427,127.23.131.125:42237,127.23.131.124:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.125.keytab
--principal=kudu/127.23.131.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.125:42237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.131.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:56:06.659075 28018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:56:06.660446 28018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:56:06.672717 28030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:06.672890 28027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:06.672853 28028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:56:06.673640 28018 server_base.cc:1034] running on GCE node
I20260809 22:56:06.674484 28018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:56:06.675951 28018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:56:06.677239 28018 hybrid_clock.cc:648] HybridClock initialized: now 1786316166677160 us; error 43 us; skew 500 ppm
I20260809 22:56:06.677615 28018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:56:06 dist-test-slave-92m1 krb5kdc[27880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:56:06.681082 28018 init.cc:377] Logged in from keytab as kudu/127.23.131.125@KRBTEST.COM (short username kudu)
I20260809 22:56:06.682709 28018 webserver.cc:460] Webserver started at http://127.23.131.125:40045/ using document root <none> and password file <none>
I20260809 22:56:06.683529 28018 fs_manager.cc:359] Metadata directory not provided
I20260809 22:56:06.683660 28018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:56:06.684026 28018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:56:06.687099 28018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data/instance:
uuid: "831d5d15e0fb4219aabf201fc49f0043"
format_stamp: "Formatted at 2026-08-09 22:56:06 on dist-test-slave-92m1"
server_key: "2f66fc9938d492a8a045c441fa06e991"
server_key_iv: "50fef8efc8ae97665d773a724005472b"
server_key_version: "encryptionkey@0"
I20260809 22:56:06.688026 28018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal/instance:
uuid: "831d5d15e0fb4219aabf201fc49f0043"
format_stamp: "Formatted at 2026-08-09 22:56:06 on dist-test-slave-92m1"
server_key: "2f66fc9938d492a8a045c441fa06e991"
server_key_iv: "50fef8efc8ae97665d773a724005472b"
server_key_version: "encryptionkey@0"
I20260809 22:56:06.693509 28018 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 22:56:06.697260 28047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:56:06.698557 28018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:56:06.698750 28018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal
uuid: "831d5d15e0fb4219aabf201fc49f0043"
format_stamp: "Formatted at 2026-08-09 22:56:06 on dist-test-slave-92m1"
server_key: "2f66fc9938d492a8a045c441fa06e991"
server_key_iv: "50fef8efc8ae97665d773a724005472b"
server_key_version: "encryptionkey@0"
I20260809 22:56:06.698971 28018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:56:06.717556 28018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:56:06.722630 28018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:56:06.722980 28018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:56:06.743076 28018 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.125:42237
I20260809 22:56:06.743099 28121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.125:42237 every 8 connection(s)
I20260809 22:56:06.744629 28018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/data/info.pb
I20260809 22:56:06.745465 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28018
I20260809 22:56:06.745694 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-1/wal/instance
I20260809 22:56:06.746315 24077 external_mini_cluster.cc:1428] Setting key 054cd6b312feb8828a6fee6bd02cc3bb
I20260809 22:56:06.748859 28122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:56:06.756009 28122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:06 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:06.781533 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.759581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40488 (local address 127.23.131.126:45427)
0809 22:56:06.760132 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:06.760137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:06.761150 (+ 1013us) server_negotiation.cc:407] Connection header received
0809 22:56:06.763078 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:06.763085 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:06.763192 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:06.763358 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:06.765067 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.765853 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.767479 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.767926 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.768071 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.775560 (+ 7489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:06.775565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:06.775568 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:06.775610 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:06.778275 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.779058 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.779064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.779068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.779194 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.779661 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.779666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.779670 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.779978 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:06.780148 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:06.780870 (+ 722us) server_negotiation.cc:299] Negotiation successful
0809 22:56:06.781102 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":323,"threads_started":1}
I20260809 22:56:06.782527 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.760215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45427 (local address 127.0.0.1:40488)
0809 22:56:06.760978 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.761023 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:06.762798 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:06.763619 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:06.763628 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:06.764262 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:06.764851 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.764868 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.766039 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.766043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.767330 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.767343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.768182 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.768189 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.768438 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.772903 (+ 4465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:06.772931 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:06.775304 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:06.778428 (+ 3124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.778439 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.778457 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.778933 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.779354 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.779360 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.779363 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.779548 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.780110 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:06.780119 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:06.780515 (+ 396us) client_negotiation.cc:769] Sending connection context
0809 22:56:06.780790 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 22:56:06.781346 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":324,"threads_started":1}
WARNING: no policy specified for kudu/127.23.131.124@KRBTEST.COM; defaulting to no policy
I20260809 22:56:06.784369 28122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.131.124@KRBTEST.COM" created.
Aug 09 22:56:06 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:56:06.800621 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.785335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56466 (local address 127.23.131.125:42237)
0809 22:56:06.786013 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:06.786019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:06.786048 (+ 29us) server_negotiation.cc:407] Connection header received
0809 22:56:06.786093 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:06.786099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:06.786268 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:06.786388 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:06.787267 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.788872 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.790020 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.790978 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.791124 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.794677 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:06.794690 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:06.794703 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:06.794738 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:06.797573 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.798410 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.798417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.798419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.798539 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.798945 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.798948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.798950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.799370 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:06.799535 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:06.799988 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 22:56:06.800303 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":516,"thread_start_us":357,"threads_started":1}
I20260809 22:56:06.800704 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.785282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56466)
0809 22:56:06.785454 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.785480 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:06.785738 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:06.786405 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:06.786408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:06.786841 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:06.786983 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.786991 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.789020 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.789024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.789877 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.789888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.791119 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.791122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.791328 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.791933 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:06.791951 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:06.794470 (+ 2519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:06.797717 (+ 3247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.797724 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.797730 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.798279 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.798643 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.798650 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.798655 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.798840 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.799494 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:06.799501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:06.799674 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 22:56:06.799834 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 22:56:06.800182 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 22:56:06.803188 28122 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:56:06.804436 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.803873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38260)
0809 22:56:06.804079 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.804218 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 22:56:06.804699 28051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:06.806420 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.805961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38266)
0809 22:56:06.806166 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.806276 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 22:56:06.806648 28122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.131.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab.
Entry for principal kudu/127.23.131.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab.
I20260809 22:56:06.832937 24077 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
/tmp/dist-test-taskNJsjXw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:36449
--webserver_interface=127.23.131.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab
--principal=kudu/127.23.131.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.131.84:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.131.126:45427,127.23.131.125:42237,127.23.131.124:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 22:56:06.856032 28122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 1
I20260809 22:56:06.857530 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.856845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38272)
0809 22:56:06.857103 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.857262 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 22:56:06.858759 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.858247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38286)
0809 22:56:06.858476 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.858592 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 22:56:06.859030 28122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:06.882134 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } attempt: 5
Aug 09 22:56:06 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:56:06.896910 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.883215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56470 (local address 127.23.131.125:42237)
0809 22:56:06.883447 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:06.883454 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:06.883491 (+ 37us) server_negotiation.cc:407] Connection header received
0809 22:56:06.883596 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:06.883602 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:06.883700 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:06.883874 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:06.884623 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.885707 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.886983 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.887736 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.887901 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.891052 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:06.891059 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:06.891065 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:06.891113 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:06.894241 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.894944 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.894949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.894952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.895085 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:06.895482 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:06.895488 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:06.895491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:06.895787 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:06.895940 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:06.896329 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 22:56:06.896557 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 22:56:06.896932 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.882931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56470)
0809 22:56:06.883274 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.883297 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:06.883416 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:06.883871 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:06.883874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:06.884261 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:06.884447 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.884455 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.885929 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.885933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.886802 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:06.886821 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:06.887896 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:06.887900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:06.888052 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:06.888702 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:06.888721 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:06.890823 (+ 2102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:06.894422 (+ 3599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.894432 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.894436 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.894822 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.895216 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:06.895223 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:06.895228 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:06.895372 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:06.895905 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:06.895910 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:06.896070 (+ 160us) client_negotiation.cc:769] Sending connection context
0809 22:56:06.896216 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 22:56:06.896581 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260809 22:56:06.898168 28008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:56:06.899305 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.898877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38290)
0809 22:56:06.899033 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.899119 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 22:56:06.900216 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.899862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38298)
0809 22:56:06.900042 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.900121 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 22:56:06.900414 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:06.927343 28122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 2
I20260809 22:56:06.928859 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.928199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38306)
0809 22:56:06.928490 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.928634 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 22:56:06.930002 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.929539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38318)
0809 22:56:06.929707 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.929803 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 22:56:06.930315 28122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:06.951638 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 1
I20260809 22:56:06.952822 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.952340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38328)
0809 22:56:06.952542 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.952649 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 22:56:06.953789 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:06.953485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38332)
0809 22:56:06.953624 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:06.953693 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 22:56:06.954104 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:07.021605 28122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 3
I20260809 22:56:07.022334 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 2
I20260809 22:56:07.023343 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.022527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38334)
0809 22:56:07.022875 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.023060 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260809 22:56:07.023474 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.022920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38348)
0809 22:56:07.023139 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.023275 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 22:56:07.024642 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.024260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38368)
0809 22:56:07.024457 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.024518 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 22:56:07.024768 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.024137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38352)
0809 22:56:07.024463 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.024593 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195}
W20260809 22:56:07.024861 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
W20260809 22:56:07.025022 28122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:07.131071 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 3
I20260809 22:56:07.132644 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.131940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38370)
0809 22:56:07.132225 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.132358 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 22:56:07.133955 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.133468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38380)
0809 22:56:07.133699 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.133797 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260809 22:56:07.134229 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:07.168339 28122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 4
I20260809 22:56:07.169852 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.169074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38390)
0809 22:56:07.169391 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.169612 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 22:56:07.171128 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.170718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38398)
0809 22:56:07.170886 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.170985 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 22:56:07.171415 28122 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
W20260809 22:56:07.219684 28135 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 22:56:07.220067 28135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 22:56:07.220187 28135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 22:56:07.220320 28135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 22:56:07.227852 28135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 22:56:07.227944 28135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 22:56:07.228052 28135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 22:56:07.228128 28135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 22:56:07.228245 28135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 22:56:07.238497 28135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.131.84:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.131.126:45427,127.23.131.125:42237,127.23.131.124:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/krb5kdc/kudu_127.23.131.124.keytab
--principal=kudu/127.23.131.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.131.124:36449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.131.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 21:48:06 UTC on ccycloud.quasar-tdsnhu.root.comops.site
build id 4576819
ASAN enabled
I20260809 22:56:07.239830 28135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 22:56:07.241134 28135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 22:56:07.253469 28144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:07.253559 28150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 22:56:07.253520 28143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 22:56:07.254686 28135 server_base.cc:1034] running on GCE node
I20260809 22:56:07.255589 28135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 22:56:07.257059 28135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 22:56:07.258312 28135 hybrid_clock.cc:648] HybridClock initialized: now 1786316167258237 us; error 46 us; skew 500 ppm
I20260809 22:56:07.258648 28135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316167, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 22:56:07.261917 28135 init.cc:377] Logged in from keytab as kudu/127.23.131.124@KRBTEST.COM (short username kudu)
I20260809 22:56:07.263455 28135 webserver.cc:460] Webserver started at http://127.23.131.124:46589/ using document root <none> and password file <none>
I20260809 22:56:07.264184 28135 fs_manager.cc:359] Metadata directory not provided
I20260809 22:56:07.264312 28135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 22:56:07.264658 28135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 22:56:07.267796 28135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data/instance:
uuid: "451f340dfc964c3f9db5351bfdde5938"
format_stamp: "Formatted at 2026-08-09 22:56:07 on dist-test-slave-92m1"
server_key: "47bfaf8ebc1a8bc26311bc0d7580b577"
server_key_iv: "7162764e2a3acfca50cfa765656c8e23"
server_key_version: "encryptionkey@0"
I20260809 22:56:07.268625 28135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal/instance:
uuid: "451f340dfc964c3f9db5351bfdde5938"
format_stamp: "Formatted at 2026-08-09 22:56:07 on dist-test-slave-92m1"
server_key: "47bfaf8ebc1a8bc26311bc0d7580b577"
server_key_iv: "7162764e2a3acfca50cfa765656c8e23"
server_key_version: "encryptionkey@0"
I20260809 22:56:07.273736 28135 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 22:56:07.277140 28160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 22:56:07.278398 28135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 22:56:07.278589 28135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal
uuid: "451f340dfc964c3f9db5351bfdde5938"
format_stamp: "Formatted at 2026-08-09 22:56:07 on dist-test-slave-92m1"
server_key: "47bfaf8ebc1a8bc26311bc0d7580b577"
server_key_iv: "7162764e2a3acfca50cfa765656c8e23"
server_key_version: "encryptionkey@0"
I20260809 22:56:07.278808 28135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 22:56:07.294586 28135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 22:56:07.299063 28135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 22:56:07.299386 28135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 22:56:07.311498 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 4
I20260809 22:56:07.312845 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.312322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38406)
0809 22:56:07.312513 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.312649 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 22:56:07.314116 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.313698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38416)
0809 22:56:07.313894 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.313990 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 22:56:07.314417 28008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.131.124:36449: Network error: Client connection negotiation failed: client connection to 127.23.131.124:36449: connect: Connection refused (error 111)
I20260809 22:56:07.319679 28135 rpc_server.cc:307] RPC server started. Bound to: 127.23.131.124:36449
I20260809 22:56:07.319741 28241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.131.124:36449 every 8 connection(s)
I20260809 22:56:07.321059 28135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/data/info.pb
I20260809 22:56:07.324910 28243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 22:56:07.327616 24077 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu as pid 28135
I20260809 22:56:07.327828 24077 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJsjXw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786315774646092-24077-0/minicluster-data/master-2/wal/instance
I20260809 22:56:07.328277 24077 external_mini_cluster.cc:1428] Setting key 6d9585a49630a1e8493b96275faa9f5d
I20260809 22:56:07.332612 28243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316167, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:07.350742 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.335381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40498 (local address 127.23.131.126:45427)
0809 22:56:07.335931 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.335939 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.336357 (+ 418us) server_negotiation.cc:407] Connection header received
0809 22:56:07.336570 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.336580 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.336665 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.336778 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.338138 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.338986 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.340818 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.341202 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.341294 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.344864 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.344869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.344872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.344902 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.347859 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.348559 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.348569 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.348572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.348699 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.349104 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.349109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.349113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.349363 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.349524 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.350042 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.350278 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":259,"threads_started":1}
I20260809 22:56:07.351534 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.335485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.126:45427 (local address 127.0.0.1:40498)
0809 22:56:07.336225 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.336265 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:07.336436 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:07.336840 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:07.336846 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:07.337650 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:07.337985 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.337998 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.339155 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.339159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.340663 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.340679 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.341434 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.341447 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.341679 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.342321 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:07.342353 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:07.344662 (+ 2309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:07.348000 (+ 3338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.348011 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.348023 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.348429 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.348819 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.348824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.348827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.348982 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.349504 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:07.349512 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:07.349696 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 22:56:07.349937 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 22:56:07.350620 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":231,"thread_start_us":369,"threads_started":1}
I20260809 22:56:07.351578 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.330021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38422 (local address 127.23.131.124:36449)
0809 22:56:07.330822 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.330832 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.330871 (+ 39us) server_negotiation.cc:407] Connection header received
0809 22:56:07.332749 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.332770 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.333182 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.333540 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.335374 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.337123 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.338678 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.339614 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.339742 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.344646 (+ 4904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.344654 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.344666 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.344701 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.347410 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.348103 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.348118 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.348120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.348285 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.348673 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.348680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.348682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.349263 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.349599 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.349941 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.350356 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"spinlock_wait_cycles":14208,"thread_start_us":391,"threads_started":1}
I20260809 22:56:07.353130 28243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316167, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.126@KRBTEST.COM
I20260809 22:56:07.366422 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.353918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.125:42237 (local address 127.0.0.1:56472)
0809 22:56:07.354150 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.354164 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:07.354284 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:07.354681 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:07.354686 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:07.355039 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:07.355170 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.355178 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.356169 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.356176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.357044 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.357055 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.357755 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.357761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.357972 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.358501 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:07.358518 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:07.360846 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:07.364084 (+ 3238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.364090 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.364094 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.364466 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.364838 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.364843 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.364846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.365046 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.365700 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:07.365703 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:07.365841 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 22:56:07.365959 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 22:56:07.366178 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260809 22:56:07.366755 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.353871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56472 (local address 127.23.131.125:42237)
0809 22:56:07.354039 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.354043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.354236 (+ 193us) server_negotiation.cc:407] Connection header received
0809 22:56:07.354421 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.354427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.354533 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.354644 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.355357 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.356033 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.357183 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.357605 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.357734 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.361034 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.361039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.361043 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.361077 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.363953 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.364584 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.364591 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.364594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.364724 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.365178 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.365186 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.365189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.365566 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.365724 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.366114 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.366368 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 22:56:07.367857 28243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } has no permanent_uuid. Determining permanent_uuid...
I20260809 22:56:07.368996 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.354411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40510 (local address 127.23.131.126:45427)
0809 22:56:07.354566 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.354572 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.354625 (+ 53us) server_negotiation.cc:407] Connection header received
0809 22:56:07.354816 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.354820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.354882 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.354980 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.356175 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.356822 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.358002 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.358397 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.358528 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.362987 (+ 4459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.362991 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.362994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.363023 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.366003 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.366829 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.366837 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.366842 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.367000 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.367471 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.367477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.367483 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.367757 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.367972 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.368431 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.368684 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316167, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.124@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.131.125@KRBTEST.COM
I20260809 22:56:07.382092 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.368689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38436 (local address 127.23.131.124:36449)
0809 22:56:07.368862 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.368868 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.369047 (+ 179us) server_negotiation.cc:407] Connection header received
0809 22:56:07.369223 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.369228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.369297 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.369383 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.370190 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.371149 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.372295 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.372761 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.372902 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.375943 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.375950 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.375955 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.375994 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.379175 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.379998 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.380002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.380004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.380130 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.380484 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.380492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.380495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.380883 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.381028 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.381384 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.381768 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":66}
I20260809 22:56:07.382066 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.368608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38436)
0809 22:56:07.368950 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.368968 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:07.369102 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:07.369441 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:07.369445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:07.369830 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:07.370041 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.370053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.371300 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.371309 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.372154 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.372165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.372916 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.372922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.373147 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.373701 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:07.373717 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:07.375754 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:07.379342 (+ 3588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.379348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.379352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.379878 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.380240 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.380245 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.380249 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.380381 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.380989 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:07.380993 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:07.381168 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 22:56:07.381306 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 22:56:07.381608 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271}
I20260809 22:56:07.386000 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.370752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56480 (local address 127.23.131.125:42237)
0809 22:56:07.370909 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.370913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.370927 (+ 14us) server_negotiation.cc:407] Connection header received
0809 22:56:07.370965 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.370968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.371035 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.371106 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.372403 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.373122 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.374279 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.374802 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.374938 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.380176 (+ 5238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.380180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.380183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.380213 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.383339 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.384035 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.384040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.384043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.384247 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.384632 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.384640 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.384645 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.384969 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.385258 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.385429 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.385651 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 22:56:07.388545 28243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: Bootstrap starting.
I20260809 22:56:07.390785 24077 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 22:56:07.392596 28243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: Neither blocks nor log segments found. Creating new log.
I20260809 22:56:07.393826 28243 log.cc:824] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: Log is configured to *not* fsync() on all Append() calls
I20260809 22:56:07.396633 28243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: No bootstrap required, opened a new log
I20260809 22:56:07.393832 27963 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "08b1fbf8a41749c6935de9e8a8e75723"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40510
I20260809 22:56:07.404422 28243 raft_consensus.cc:348] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.404839 28243 raft_consensus.cc:729] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451f340dfc964c3f9db5351bfdde5938, State: Initialized, Role: FOLLOWER
I20260809 22:56:07.405274 28243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.406149 28253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.406608 28253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:07.407482 28243 sys_catalog.cc:564] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 22:56:07.417021 28272 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:56:07.417168 28272 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:56:07.414848 28135 master_runner.cc:186] Error getting master registration for 127.23.131.126:45427: OK, instance_id { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" instance_seqno: 1786316166164472 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 22:56:07.423013 28135 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 22:56:07.470639 28122 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 5
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.125@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
I20260809 22:56:07.487617 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.471429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38446)
0809 22:56:07.471685 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.471708 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:07.471853 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:07.472268 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:07.472273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:07.472841 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:07.473064 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.473079 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.474563 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.474570 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.476026 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.476042 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.477046 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.477052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.477307 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.478008 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:07.478033 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:07.480761 (+ 2728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:07.484787 (+ 4026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.484792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.484796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.485166 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.485581 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.485585 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.485589 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.485770 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.486513 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:07.486521 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:07.486691 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 22:56:07.486865 (+ 174us) client_negotiation.cc:240] Negotiation successful
0809 22:56:07.487171 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 22:56:07.487668 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.471469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38446 (local address 127.23.131.124:36449)
0809 22:56:07.471674 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.471685 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.471817 (+ 132us) server_negotiation.cc:407] Connection header received
0809 22:56:07.471990 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.471996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.472085 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.472202 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.473219 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.474396 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.476171 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.476886 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.477009 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.480955 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.480960 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.480963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.480993 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.484647 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.485308 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.485314 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.485317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.485469 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.485896 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.485902 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.485905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.486365 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.486515 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.487002 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.487257 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 22:56:07.493758 28122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: Bootstrap starting.
I20260809 22:56:07.497928 28122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: Neither blocks nor log segments found. Creating new log.
I20260809 22:56:07.498993 28122 log.cc:824] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: Log is configured to *not* fsync() on all Append() calls
I20260809 22:56:07.501717 28122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: No bootstrap required, opened a new log
I20260809 22:56:07.509439 28122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.509788 28122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831d5d15e0fb4219aabf201fc49f0043, State: Initialized, Role: FOLLOWER
I20260809 22:56:07.510291 28122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.511304 28276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.511731 28276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:07.512429 28122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 22:56:07.523138 28300 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 22:56:07.523288 28300 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 22:56:07.520107 28018 master_runner.cc:186] Error getting master registration for 127.23.131.126:45427: OK, instance_id { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" instance_seqno: 1786316166164472 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 22:56:07.532042 28018 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 22:56:07.551571 28174 tablet.cc:2369] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:56:07.591660 28008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } attempt: 5
Aug 09 22:56:07 dist-test-slave-92m1 krb5kdc[27880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786316166, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.131.126@KRBTEST.COM for kudu/127.23.131.124@KRBTEST.COM
I20260809 22:56:07.610551 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.592573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38460 (local address 127.23.131.124:36449)
0809 22:56:07.592794 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.592800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.592914 (+ 114us) server_negotiation.cc:407] Connection header received
0809 22:56:07.593118 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.593129 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.593278 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.593404 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.594500 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.595741 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.597604 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.598369 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.598516 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.603002 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.603009 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.603014 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.603060 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.607163 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.608086 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.608094 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.608098 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.608289 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.608788 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.608794 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.608798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.609196 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.609360 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.609865 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.610135 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 22:56:07.610559 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.592468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.131.124:36449 (local address 127.0.0.1:38460)
0809 22:56:07.592809 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 22:56:07.592833 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 22:56:07.592977 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 22:56:07.593467 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 22:56:07.593472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 22:56:07.594078 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0809 22:56:07.594306 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.594320 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.595889 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.595895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.597426 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 22:56:07.597446 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.598525 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.598531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 22:56:07.598767 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.599536 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 22:56:07.599561 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 22:56:07.602763 (+ 3202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 22:56:07.607369 (+ 4606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.607376 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.607380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.607959 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.608450 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 22:56:07.608456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 22:56:07.608460 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 22:56:07.608666 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 22:56:07.609365 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 22:56:07.609372 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 22:56:07.609559 (+ 187us) client_negotiation.cc:769] Sending connection context
0809 22:56:07.609734 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 22:56:07.610047 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260809 22:56:07.617468 28008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723: Bootstrap starting.
I20260809 22:56:07.621809 28008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723: Neither blocks nor log segments found. Creating new log.
I20260809 22:56:07.623281 28008 log.cc:824] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723: Log is configured to *not* fsync() on all Append() calls
I20260809 22:56:07.628041 28008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723: No bootstrap required, opened a new log
I20260809 22:56:07.640204 28008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.640834 28008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b1fbf8a41749c6935de9e8a8e75723, State: Initialized, Role: FOLLOWER
I20260809 22:56:07.641618 28008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.642975 28305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.643512 28305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:07.645113 27963 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 22:56:07.645313 27963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:56:07.646590 28008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 22:56:07.649864 27963 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.652320 28087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08b1fbf8a41749c6935de9e8a8e75723" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "831d5d15e0fb4219aabf201fc49f0043"
I20260809 22:56:07.652853 28087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [term 0 FOLLOWER]: Advancing to term 1
W20260809 22:56:07.653100 27931 tablet.cc:2369] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:56:07.656339 28087 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08b1fbf8a41749c6935de9e8a8e75723 in term 1.
I20260809 22:56:07.657310 27926 leader_election.cc:302] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b1fbf8a41749c6935de9e8a8e75723, 831d5d15e0fb4219aabf201fc49f0043; no voters:
I20260809 22:56:07.657773 28305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 22:56:07.659049 28208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "08b1fbf8a41749c6935de9e8a8e75723" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "451f340dfc964c3f9db5351bfdde5938"
I20260809 22:56:07.659595 28208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [term 0 FOLLOWER]: Advancing to term 1
I20260809 22:56:07.663256 28208 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08b1fbf8a41749c6935de9e8a8e75723 in term 1.
I20260809 22:56:07.664034 27963 leader_election.cc:288] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [CANDIDATE]: Term 1 election: Requested vote from peers 831d5d15e0fb4219aabf201fc49f0043 (127.23.131.125:42237), 451f340dfc964c3f9db5351bfdde5938 (127.23.131.124:36449)
I20260809 22:56:07.667495 28305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [term 1 LEADER]: Becoming Leader. State: Replica: 08b1fbf8a41749c6935de9e8a8e75723, State: Running, Role: LEADER
I20260809 22:56:07.668089 28305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } }
I20260809 22:56:07.678352 28307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08b1fbf8a41749c6935de9e8a8e75723. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.678965 28307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: This master's current role is: LEADER
I20260809 22:56:07.695572 28315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 22:56:07.711182 28315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 22:56:07.726289 28054 tablet.cc:2369] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 22:56:07.749585 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.691270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.23.131.126:45427)
0809 22:56:07.691512 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.691522 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.708790 (+ 17268us) server_negotiation.cc:407] Connection header received
0809 22:56:07.709149 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.709156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.709252 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.709337 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.713784 (+ 4447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.715020 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.720881 (+ 5861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.722786 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.722971 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.738130 (+ 15159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.738138 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.738145 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.738214 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.742254 (+ 4040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.743375 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.743384 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.743389 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.743571 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.745386 (+ 1815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.745393 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.745398 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.745847 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.746145 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.748907 (+ 2762us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.749177 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 22:56:07.757326 28087 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [term 1 FOLLOWER]: Refusing update from remote peer 08b1fbf8a41749c6935de9e8a8e75723: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:56:07.757375 28208 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [term 1 FOLLOWER]: Refusing update from remote peer 08b1fbf8a41749c6935de9e8a8e75723: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 22:56:07.758720 28307 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [LEADER]: Connected to new peer: Peer: permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:56:07.759513 28305 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 22:56:07.777504 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.692927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56494 (local address 127.23.131.125:42237)
0809 22:56:07.693148 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.693156 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.712523 (+ 19367us) server_negotiation.cc:407] Connection header received
0809 22:56:07.717163 (+ 4640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.717169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.717266 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.717339 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.722607 (+ 5268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.723743 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.731681 (+ 7938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.732426 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.732554 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.766379 (+ 33825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.766388 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.766397 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.766450 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.770372 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.774322 (+ 3950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.774329 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.774332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.774537 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.775060 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.775066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.775069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.775535 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.775795 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.776831 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.777114 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 22:56:07.785502 28276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08b1fbf8a41749c6935de9e8a8e75723. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.785879 28276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:07.789014 28342 mvcc.cc:205] Tried to move back new op lower bound from 7316751023110905856 to 7316751022763442176. Current Snapshot: MvccSnapshot[applied={T|T < 7316751023110905856}]
I20260809 22:56:07.796720 28341 mvcc.cc:205] Tried to move back new op lower bound from 7316751023110905856 to 7316751022763442176. Current Snapshot: MvccSnapshot[applied={T|T < 7316751023110905856}]
I20260809 22:56:07.799238 28305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.799575 28305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: This master's current role is: LEADER
I20260809 22:56:07.800802 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:07.713125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38476 (local address 127.23.131.124:36449)
0809 22:56:07.713341 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.713352 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:07.722309 (+ 8957us) server_negotiation.cc:407] Connection header received
0809 22:56:07.729339 (+ 7030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:07.729346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:07.729466 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:07.729554 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:07.733645 (+ 4091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.734819 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.746694 (+ 11875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:07.747512 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:07.747636 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:07.779617 (+ 31981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 22:56:07.779624 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 22:56:07.779629 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 22:56:07.779677 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 22:56:07.783927 (+ 4250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.795787 (+ 11860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.795794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.795798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.795975 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 22:56:07.797269 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 22:56:07.797278 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 22:56:07.797284 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 22:56:07.797857 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 22:56:07.798173 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:07.799993 (+ 1820us) server_negotiation.cc:299] Negotiation successful
0809 22:56:07.800374 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 22:56:07.805091 28276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.805356 28276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:07.807953 28315 catalog_manager.cc:1347] Generated new cluster ID: a2e6d4068e624d4cb3e06c300986e69f
I20260809 22:56:07.808069 28315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 22:56:07.820641 28253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08b1fbf8a41749c6935de9e8a8e75723. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.821015 28253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 22:56:07.822227 28357 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 22:56:07.836019 28307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.836340 28307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723 [sys.catalog]: This master's current role is: LEADER
I20260809 22:56:07.844461 28315 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 22:56:07.846288 28315 catalog_manager.cc:1504] Loading token signing keys...
I20260809 22:56:07.868050 28315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08b1fbf8a41749c6935de9e8a8e75723: Generated new TSK 0
I20260809 22:56:07.869573 28315 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 22:56:07.872573 28253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08b1fbf8a41749c6935de9e8a8e75723" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b1fbf8a41749c6935de9e8a8e75723" member_type: VOTER last_known_addr { host: "127.23.131.126" port: 45427 } } peers { permanent_uuid: "831d5d15e0fb4219aabf201fc49f0043" member_type: VOTER last_known_addr { host: "127.23.131.125" port: 42237 } } peers { permanent_uuid: "451f340dfc964c3f9db5351bfdde5938" member_type: VOTER last_known_addr { host: "127.23.131.124" port: 36449 } } }
I20260809 22:56:07.872921 28253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 22:56:08.006572 28249 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:07.998819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.23.131.126:45427)
0809 22:56:07.999028 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.999034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.004430 (+ 5396us) server_negotiation.cc:407] Connection header received
0809 22:56:08.004783 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.004790 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.004890 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.004988 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.006271 (+ 1283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40526: BlockingRecv error: recv got EOF from 127.0.0.1:40526 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 22:56:08.009241 28248 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.004230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38480 (local address 127.23.131.124:36449)
0809 22:56:08.004426 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.004431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.007308 (+ 2877us) server_negotiation.cc:407] Connection header received
0809 22:56:08.007663 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.007669 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.007759 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.007833 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.008994 (+ 1161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38480: BlockingRecv error: recv got EOF from 127.0.0.1:38480 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 22:56:08.011436 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:07.998431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56508 (local address 127.23.131.125:42237)
0809 22:56:07.998654 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:07.998660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.008939 (+ 10279us) server_negotiation.cc:407] Connection header received
0809 22:56:08.009747 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.009754 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.009838 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.009910 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.011103 (+ 1193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56508: BlockingRecv error: recv got EOF from 127.0.0.1:56508 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 22:56:08.026553 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.024166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56518 (local address 127.23.131.125:42237)
0809 22:56:08.024345 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.024351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.024859 (+ 508us) server_negotiation.cc:407] Connection header received
0809 22:56:08.025134 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.025139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.025281 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.025394 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.026271 (+ 877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56518: BlockingRecv error: recv got EOF from 127.0.0.1:56518 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 22:56:08.033433 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.031002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.23.131.125:42237)
0809 22:56:08.031192 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.031228 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.031778 (+ 550us) server_negotiation.cc:407] Connection header received
0809 22:56:08.031954 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.031960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.032082 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.032214 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.033222 (+ 1008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56522: BlockingRecv error: recv got EOF from 127.0.0.1:56522 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 22:56:08.043601 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.041381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56538 (local address 127.23.131.125:42237)
0809 22:56:08.041552 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.041558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.042040 (+ 482us) server_negotiation.cc:407] Connection header received
0809 22:56:08.042232 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.042237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.042321 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.042424 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.043323 (+ 899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56538: BlockingRecv error: recv got EOF from 127.0.0.1:56538 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 22:56:08.053555 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.051250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.23.131.125:42237)
0809 22:56:08.051479 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.051485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.052037 (+ 552us) server_negotiation.cc:407] Connection header received
0809 22:56:08.052237 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.052243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.052335 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.052443 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.053290 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56550: BlockingRecv error: recv got EOF from 127.0.0.1:56550 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
W20260809 22:56:08.070716 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.068352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56560 (local address 127.23.131.125:42237)
0809 22:56:08.068548 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.068554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.069115 (+ 561us) server_negotiation.cc:407] Connection header received
0809 22:56:08.069317 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.069328 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.069424 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.069539 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.070420 (+ 881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56560: BlockingRecv error: recv got EOF from 127.0.0.1:56560 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 22:56:08.092784 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.090322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56564 (local address 127.23.131.125:42237)
0809 22:56:08.090560 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.090567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.091076 (+ 509us) server_negotiation.cc:407] Connection header received
0809 22:56:08.091368 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.091375 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.091467 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.091581 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.092467 (+ 886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56564: BlockingRecv error: recv got EOF from 127.0.0.1:56564 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260809 22:56:08.135543 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.133014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56572 (local address 127.23.131.125:42237)
0809 22:56:08.133209 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.133215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.133799 (+ 584us) server_negotiation.cc:407] Connection header received
0809 22:56:08.134028 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.134035 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.134146 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.134263 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.135228 (+ 965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56572: BlockingRecv error: recv got EOF from 127.0.0.1:56572 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 22:56:08.205787 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.203707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.23.131.125:42237)
0809 22:56:08.203958 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.203965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.204361 (+ 396us) server_negotiation.cc:407] Connection header received
0809 22:56:08.204507 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.204513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.204619 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.204772 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.205545 (+ 773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56582: BlockingRecv error: recv got EOF from 127.0.0.1:56582 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260809 22:56:08.339417 28131 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 22:56:08.337540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56590 (local address 127.23.131.125:42237)
0809 22:56:08.337750 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.337757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.338139 (+ 382us) server_negotiation.cc:407] Connection header received
0809 22:56:08.338272 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.338275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.338350 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.338443 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 22:56:08.339170 (+ 727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56590: BlockingRecv error: recv got EOF from 127.0.0.1:56590 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 22:56:08.419281 28272 catalog_manager.cc:1259] Loaded cluster ID: a2e6d4068e624d4cb3e06c300986e69f
I20260809 22:56:08.419389 28272 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: loading cluster ID for follower catalog manager: success
I20260809 22:56:08.421988 28272 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: acquiring CA information for follower catalog manager: success
I20260809 22:56:08.423988 28272 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 451f340dfc964c3f9db5351bfdde5938: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 22:56:08.525399 28300 catalog_manager.cc:1259] Loaded cluster ID: a2e6d4068e624d4cb3e06c300986e69f
I20260809 22:56:08.525511 28300 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: loading cluster ID for follower catalog manager: success
I20260809 22:56:08.528152 28300 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: acquiring CA information for follower catalog manager: success
I20260809 22:56:08.529974 28300 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 831d5d15e0fb4219aabf201fc49f0043: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 22:56:08.607599 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:08.601112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56600 (local address 127.23.131.125:42237)
0809 22:56:08.601348 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.601355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.601550 (+ 195us) server_negotiation.cc:407] Connection header received
0809 22:56:08.601790 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.601801 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.601968 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.602094 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:08.602550 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.603618 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.605155 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.605586 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.605735 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:08.606284 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:08.606844 (+ 560us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:08.607034 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:08.607153 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 22:56:08.607282 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 22:56:08.619771 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:08.614183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38494 (local address 127.23.131.124:36449)
0809 22:56:08.614692 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.614696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.614809 (+ 113us) server_negotiation.cc:407] Connection header received
0809 22:56:08.614997 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.615001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.615198 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.615434 (+ 236us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:08.615772 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.616585 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.617770 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.618147 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.618254 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:08.618678 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:08.619177 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:08.619355 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:08.619425 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 22:56:08.619495 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":282,"threads_started":1}
I20260809 22:56:08.633278 28465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:08.625504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40540 (local address 127.23.131.126:45427)
0809 22:56:08.626446 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.626452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.626469 (+ 17us) server_negotiation.cc:407] Connection header received
0809 22:56:08.626562 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.626565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.626709 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.626892 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:08.627613 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.628263 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.630247 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.630893 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.631009 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:08.631903 (+ 894us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:08.632249 (+ 346us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:08.632372 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:08.632909 (+ 537us) server_negotiation.cc:299] Negotiation successful
0809 22:56:08.633016 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":800,"thread_start_us":683,"threads_started":1}
I20260809 22:56:08.634177 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:08.625502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56608 (local address 127.23.131.125:42237)
0809 22:56:08.625722 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.625730 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.626878 (+ 1148us) server_negotiation.cc:407] Connection header received
0809 22:56:08.627250 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.627260 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.627416 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.627506 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:08.628485 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.629570 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.631764 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.632438 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.632563 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:08.633148 (+ 585us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:08.633287 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:08.633384 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:08.633811 (+ 427us) server_negotiation.cc:299] Negotiation successful
0809 22:56:08.633909 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 22:56:08.636242 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 22:56:08.627060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38496 (local address 127.23.131.124:36449)
0809 22:56:08.627225 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 22:56:08.627232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 22:56:08.629124 (+ 1892us) server_negotiation.cc:407] Connection header received
0809 22:56:08.629322 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 22:56:08.629328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 22:56:08.629399 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 22:56:08.629497 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 22:56:08.630286 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.631319 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.633458 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 22:56:08.634076 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 22:56:08.634215 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 22:56:08.635485 (+ 1270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 22:56:08.635640 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 22:56:08.635733 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 22:56:08.635889 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 22:56:08.635955 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 22:56:08.638312 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 27900
I20260809 22:56:08.639498 28003 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:56:08.752751 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 27900
I20260809 22:56:08.787799 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28018
I20260809 22:56:08.788975 28115 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:56:08.903647 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28018
I20260809 22:56:08.931641 24077 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu pid 28135
I20260809 22:56:08.932817 28236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 22:56:09.043848 24077 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJsjXw/build/asan/bin/kudu with pid 28135
2026-08-09T22:56:09Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5155 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10377 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (394356 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST